harald/nixcfg
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
nixcfg/systems/x86_64-linux/halo
History
Harald Hoyer 0edf975c30 feat(halo): serve multiple llama models via models.ini preset 
Replace the per-model llama-server units with a single service that
uses llama-server's --models-preset (models.ini) and --models-max 2,
so the 35B-A3B and 27B models are loaded on demand from one config.

Drop the now-redundant 27B / 27B-MTP / coder-next variant files and
the unused CacheDirectory + slot-save-path KV-slot handling.
2026-05-20 00:23:50 +02:00
..
default.nix feat(halo): serve multiple llama models via models.ini preset 2026-05-20 00:23:50 +02:00
hardware-configuration.nix feat(halo): verbose boot 2026-02-17 09:17:24 +01:00
llama-server.nix feat(halo): serve multiple llama models via models.ini preset 2026-05-20 00:23:50 +02:00
models.ini feat(halo): serve multiple llama models via models.ini preset 2026-05-20 00:23:50 +02:00
sound.nix chore: nix fmt 2026-05-03 14:57:49 +02:00
wyoming.nix nix fmt 2026-02-24 13:25:42 +01:00
xremap.nix chore: nix fmt 2026-05-03 14:57:49 +02:00