nixcfg/packages/rag
Harald Hoyer 6fd6060dd7 fix(rag): send explicit encoding_format to avoid llama.cpp null error
When encoding_format is unset, LiteLLM forwards it to the backend as JSON
null, and llama.cpp's embeddings endpoint rejects it with a 500
("type must be string, but is null"). Pin encoding_format="float" so the
gateway always relays a string.
2026-05-22 08:34:42 +02:00
..
default.nix fix(rag): send explicit encoding_format to avoid llama.cpp null error 2026-05-22 08:34:42 +02:00