harald/nixcfg
1
0
Fork 0
Code Issues Pull requests 4 Projects Releases Packages Wiki Activity Actions

feat(packages): add sglang-ssd-stream-test harness for the PLE decision #24

Open
hermes wants to merge 1 commit from hermes/ssd-stream-test-v2 into main AGit
pull from: hermes/ssd-stream-test-v2
merge into: harald:main
Conversation 0 Commits 1 Files changed 2 +194
hermes commented 2026-08-29 10:00:51 +02:00
Contributor
Copy link

Test-only package: pinned fork of upstream sglang-ssd-stream's install
(wheel v0.1.0 sha256-pinned, SGLang 3df8e1e7, flashinfer 0.6.17) plus a
shared streaming tok/s bench, to measure the SSD-streamed PLE alternative
against the productive SGLang container before committing to the 128 GiB
RAM purchase for --ple-offload-embedding. Not wired into any host.

Co-authored-by: Hermes hermes@hoyer.xyz

Test-only package: pinned fork of upstream sglang-ssd-stream's install (wheel v0.1.0 sha256-pinned, SGLang 3df8e1e7, flashinfer 0.6.17) plus a shared streaming tok/s bench, to measure the SSD-streamed PLE alternative against the productive SGLang container before committing to the 128 GiB RAM purchase for --ple-offload-embedding. Not wired into any host. Co-authored-by: Hermes <hermes@hoyer.xyz>
feat(packages): add sglang-ssd-stream-test harness for the PLE decision
All checks were successful
nix flake check / flake-check (pull_request) Successful in 3m51s
Details
31bd2f274d 
Test-only package: pinned fork of upstream sglang-ssd-stream's install
(wheel v0.1.0 sha256-pinned, SGLang 3df8e1e7, flashinfer 0.6.17) plus a
shared streaming tok/s bench, to measure the SSD-streamed PLE alternative
against the productive SGLang container before committing to the 128 GiB
RAM purchase for --ple-offload-embedding. Not wired into any host.

Co-authored-by: Hermes <hermes@hoyer.xyz>
All checks were successful
nix flake check / flake-check (pull_request) Successful in 3m51s
Details
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin +refs/pull/24/head:hermes/ssd-stream-test-v2
git switch hermes/ssd-stream-test-v2
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
harald/nixcfg!24
No description provided.