fix(strata): ship a hipBLASLt table calibrated for ROCm 10.1

Upstream's gfx1151-hipblaslt-100401.txt was calibrated on TheRock 7.14.1.
therock-rocm 10.1.0rc3 reports the same hipBLASLt version, so the engine
accepted the table, but its solution ids do not exist in that build and
every prompt GEMM fell back to the heuristic. The table now comes from
tools/hip/tune_hipblaslt run on gfx1151 against therock-rocm 10.1 and is
installed in bin/tuning/, where the engine finds it by itself.

UD-Q5_K_XL, 17.5K cold prompt on ms-s1-max: 418 -> 700-725 tok/s.

Bead: nix-overlay-2yv
This commit is contained in:
2026-11-16 20:22:23 +03:00
parent 598985f7c9
commit d14f6d5e37
3 changed files with 101 additions and 0 deletions
+8
View File
@@ -82,6 +82,12 @@ stdenv.mkDerivation (finalAttrs: {
ninjaFlags = [ "strata" ];
# Upstream's 100401 table was calibrated on TheRock 7.14.1. therock-rocm 10.1 reports the same
# hipBLASLt version but other solution ids, so that table is a silent no-op here.
postPatch = ''
cp ${./gfx1151-hipblaslt-100401.txt} tools/hip/gfx1151-hipblaslt-100401.txt
'';
postBuild = ''
cmake -S ../tools/vision -B ../build-vision -G Ninja \
-DCMAKE_BUILD_TYPE=Release -DLLAMA_DIR=${llama} \
@@ -93,6 +99,8 @@ stdenv.mkDerivation (finalAttrs: {
runHook preInstall
install -Dm755 strata $out/bin/strata
install -Dm755 ../build-vision/bin/strata-vision $out/bin/strata-vision
# The engine reads <exe dir>/tuning/ by itself (postPatch puts the 10.1 table in tools/hip).
install -Dm644 ../tools/hip/gfx1151-hipblaslt-100401.txt $out/bin/tuning/gfx1151-hipblaslt-100401.txt
mkdir -p $out/share/strata
cp -r ../serve ../strata_control ../strata_cli ../tools ../data $out/share/strata/
makeWrapper ${python}/bin/python $out/bin/strata-server \