Files
millerson-overlay.nix/packages/strata
alex b3287c926f feat(strata): bump 0.2.13 -> 0.2.15
Strata 0.2.14 runs the prompt on its own kernels and vendors llama.cpp
(third_party/strata-llama), so the separate llama.cpp fetch for the
vision encoder goes. The build keeps upstream's halo flags: MMQ stays
out (STRATA_MMQ defaults to OFF), 47 of 48 UD-Q5_K_XL layers run on the
fused kernels, and the ROCm 10.1 hipBLASLt table still ships.

UD-Q5_K_XL on ms-s1-max, 16K cold prompts: 715 -> ~810 tok/s on the
defaults, ~1180 tok/s with the gfx1151 prompt set (unchanged).

Bead: nix-overlay-ydg
2026-11-16 20:51:14 +03:00
..