Files
millerson-overlay.nix/packages
alex afd0c4b84d
CI / check (push) Has been cancelled
perf(kyojin): Let short replies finish before a long prefill
Give two-session Qwen serving a bounded, opt-in decode grace for large cold prompts. Returning to normal interleaving at the deadline bounds the wait when the running reply takes longer than expected.

Bead: nix-overlay-qfi
2026-11-18 15:19:23 +03:00
..
2026-11-13 14:13:50 +03:00