harald/nixcfg
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

fix(sgx): pull litellm from unstable for embeddings fix

Browse source 
LiteLLM 1.75.5 in nixpkgs 25.11 crashes on /v1/embeddings with
"RuntimeError: Stream consumed" (the proxy reads the request body twice).
Source litellm from nixos-unstable (1.83.14) where this is resolved, so
the gateway can proxy embeddings to halo's bge-m3 for any client.
This commit is contained in:
Harald Hoyer 2026-05-22 08:25:47 +02:00
parent 116d04665d
commit f0fe1d5b27
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
overlays/unstable/default.nix
View file

@ -7,6 +7,7 @@ final: prev: {
mistral-vibe mistral-vibe
claude-code claude-code
qwen-code qwen-code
litellm # 25.11's 1.75.5 has a /v1/embeddings "Stream consumed" bug
# llama-cpp-rocm # llama-cpp-rocm
# open-webui # open-webui
# vscode # vscode