Commit graph

28 commits

Author SHA1 Message Date
a95417da8b feat(halo): use unsloth/Qwen3.6-27B-GGUF:UD-Q8_K_XL 2026-05-06 13:02:20 +02:00
da88a9b2d6 fix(halo): drop speculative HSA_OVERRIDE_GFX_VERSION from llama-server
Was set defensively without knowing the actual GPU arch; if ROCm
supports the card natively, the override is at best a no-op and at
worst masks the real arch. Add it back with the right value if the
service actually fails to detect the GPU.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-05 11:42:17 +02:00
b11e5c8356 feat(halo): add llama-server systemd unit for Qwen3.6-35B-A3B
Runs llama.cpp's ROCm build under DynamicUser, with the HF model cache
in StateDirectory (survives systemctl clean) and KV slot saves in
CacheDirectory. Listens on :8000.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-05 11:42:17 +02:00
f74928ce5f chore: nix fmt 2026-05-03 14:57:49 +02:00
e96bf83dfd feat(halo): add python313Packages.huggingface-hub 2026-05-03 09:00:13 +02:00
6d0186eadb chore: statix fix 2026-04-20 10:09:24 +02:00
866bc090ca feat(halo): add llama-cpp-rocm and real docker 2026-03-17 10:03:54 +01:00
3db2e2a226 fix: halo 2026-03-17 10:03:54 +01:00
6029a6908b feat(halo): add user to audio group 2026-03-10 14:21:35 +01:00
d82ac6915c feat(halo): add linger 2026-03-10 14:21:35 +01:00
0e4f847145 feat(halo): add sound 2026-03-10 13:35:24 +01:00
e4ff822a88 feat(halo): open more ports 2026-02-26 11:48:26 +01:00
04150f10d4 nix fmt 2026-02-24 13:25:42 +01:00
27343e49bd feat(halo): add wyoming whisper-cpp 2026-02-24 13:16:28 +01:00
b5e7d5031a feat(halo): add wyoming 2026-02-24 10:56:58 +01:00
4722d5ef88 fix(halo): remove rocm patches 2026-02-17 16:45:23 +01:00
14670bb0fa fix(halo): patch rocm-runtime 2026-02-17 13:05:35 +01:00
211daf3dc9 feat(halo): enable podman 2026-02-17 10:48:22 +01:00
c24572c318 feat(halo): enable hw graphics 2026-02-17 10:40:56 +01:00
61cb051f44 feat(halo): verbose boot 2026-02-17 09:17:24 +01:00
91ffb24bc6 feat(halo): more mem headroom 2026-02-17 09:05:43 +01:00
fbc78bdbb6 feat(halo): optimize 2026-02-17 09:03:00 +01:00
170189e56e fix(halo): kernel command line parameters 2026-02-12 13:37:27 +01:00
9d2275ddf7 fix(halo): open port 8000 2026-02-12 13:37:06 +01:00
58a0abf24d feat(nix): add opencode to HALO and AMD system packages
- Included `opencode` in the `packages` list for both HALO and AMD system configurations.
- Improves development environment by providing additional tooling.
2026-02-11 16:54:41 +01:00
f9e621eaae feat(nix): add firewall rule for HALO system
- Allowed inbound TCP traffic on port 1234 by updating firewall rules.
- Enhances connectivity for the HALO system without altering existing configurations.
2026-02-11 16:53:18 +01:00
e5615c85bf feat(nix): update secure boot and HALO system configuration
- Set `pkiBundle` in `secureboot` to use `mkDefault` for better configurability.
- Added kernel parameters for HALO, improving performance and boot customization.
- Configured ROCm symlink and switched HALO to `linuxPackages_latest`.
2026-02-11 16:33:50 +01:00
52e1276115 feat(nix): add HALO system configuration and user setup
- Added system configuration for the HALO machine, including hardware, sound, and remapping settings.
- Configured user-specific settings like session paths, favorite apps, and terminal customization.
- Introduced zram swap, SSD TRIM, and PipeWire priority tuning for performance optimization.
2026-02-11 14:24:08 +01:00