harald/nixcfg
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

feat(litellm): add LiteLLM gateway on sgx fronting halo's llama-server

Browse source 
Exposes an OpenAI-compatible endpoint on sgx:4000 (LAN-reachable) that
routes the `coder` model to halo's llama-server, so clients get a stable
gateway with per-key auth instead of hardcoding halo's address. Master
key is sourced from a sops-encrypted env file.
This commit is contained in:
Harald Hoyer 2026-05-21 23:08:15 +02:00
parent ccd8750899
commit fdefdf31b2
3 changed files with 79 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
systems/x86_64-linux/sgx/default.nix
View file

@ -11,6 +11,7 @@
./mail.nix
./wyoming.nix
./searx.nix
./litellm.nix
./uptime-kuma.nix
./firefly.nix
./opencode.nix