Harald Hoyer
f0fe1d5b27
LiteLLM 1.75.5 in nixpkgs 25.11 crashes on /v1/embeddings with "RuntimeError: Stream consumed" (the proxy reads the request body twice). Source litellm from nixos-unstable (1.83.14) where this is resolved, so the gateway can proxy embeddings to halo's bge-m3 for any client. |
||
|---|---|---|
| .. | ||
| extern | ||
| inetutils-darwin-fix | ||
| mods | ||
| unstable | ||