harald/nixcfg
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
749 commits 4 branches 0 tags 17 MiB
Commit graph

1 commit

Author SHA1 Message Date
Harald Hoyer
b11e5c8356 feat(halo): add llama-server systemd unit for Qwen3.6-35B-A3B 
Runs llama.cpp's ROCm build under DynamicUser, with the HF model cache
in StateDirectory (survives systemctl clean) and KV slot saves in
CacheDirectory. Listens on :8000.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-05 11:42:17 +02:00