feat(rocm): Vendor SDK recipe and update to 10.1

Maintain the gfx1151 SDK locally using the official AMD archive. Use the TheRock patchelf pin and adapt LLVM auxiliary tools for pure Nix builds.

Verify SDK installation, HIP and rocBLAS GPU operations, and rebuild its consumers. Document the internal rc3 stamp and upstream migration findings.
This commit is contained in:
2026-11-12 23:40:48 +03:00
parent 00dc8c2c8c
commit 16166f115b
9 changed files with 425 additions and 17 deletions
+10 -6
View File
@@ -42,7 +42,7 @@ A custom Nix overlay and flake providing additional packages not found in upstre
| `hipfire-kernels` | Precompiled hipfire kernels for gfx1151 | AI Inference |
| `gufo` | Gufo with XDNA2 NPU support and the Unsloth UD 3.1 compatibility patch | AI Inference |
| `xrt-amdxdna` | XRT with the amdxdna plugin, built against gufo's nixpkgs | AI Inference |
| `therock-rocm` | TheRock 10.0 SDK for gfx1151 | AI Inference |
| `therock-rocm` | Locally maintained TheRock 10.1 SDK for gfx1151 | AI Inference |
| `strata` | Strata inference engine, API server and CPU vision encoder with ROCm 10 HIP support for gfx1151 | AI Inference |
| `crucible-strix-halo` | Crucible EXL3 inference engine and OpenAI-compatible server for gfx1151 with the ROCm 10 runtime | AI Inference |
| `strixite` | Source-built HIP inference engine and OpenAI-compatible server for gfx1151 / Zen 5 with ROCm 10 | AI Inference |
@@ -133,12 +133,16 @@ ROCm overlay as `overlays.hipfire`. Neither is enabled by the default module.
Gufo exports its matching `xrt`, `npuDir` and `fabricClock` as package attributes.
The consumer must configure NPU power and fabric clocks before using the NPU.
TheRock and XRT use individual recipes from the pinned `nix-strix-halo` source
tree. Its flake and Thunderbolt dependencies are not loaded.
TheRock uses this repository's own SDK recipe and a pinned official AMD tarball.
The 10.1.0 archive's internal package stamp is `10.1.0rc3`.
See [TheRock maintenance notes](docs/therock-rocm.md) for the source, update
procedure and nixpkgs migration context. XRT still uses an individual recipe from
the pinned `nix-strix-halo` source tree; its flake and Thunderbolt dependencies
are not loaded.
Strata ships `strata` (the HIP engine), `strata-server` (the OpenAI/Anthropic HTTP
server, also the default for `nix run .#strata`) and `strata-vision` (CPU image
encoder). It uses the shared TheRock ROCm 10.0 SDK, compiles GPU kernels only for
encoder). It uses the shared TheRock ROCm 10.1 SDK, compiles GPU kernels only for
`gfx1151`, and uses upstream's portable AVX2 CPU baseline. Model weights and vision
projectors are supplied separately.
@@ -153,7 +157,7 @@ with ROCm 10; the engine falls back to hipBLAS when no matching table is supplie
Crucible ships `crucible-server` (also `nix run .#crucible-strix-halo`) and
`crucible-engine`. It uses upstream's release engine compiled with ROCm 7.2.4,
patched to use this overlay's TheRock ROCm 10.0 runtime. Upstream requires the
patched to use this overlay's TheRock ROCm 10.1 runtime. Upstream requires the
7.2.4 compiler for source builds. The Python server comes from the matching tag.
The package targets the Ryzen AI Max+ 395 / Radeon 8060S (`gfx1151`) with 128 GB
RAM. Supply a compatible Qwen3.8-Flash-Next EXL3 pack separately:
@@ -169,7 +173,7 @@ is not included. Model downloads and conversation state belong outside the Nix
store. See the upstream [setup guide](https://github.com/jaedync/crucible-strix-halo/blob/v0.37.0/docs/QUICKSTART.md)
for GPU memory configuration and model requirements.
Strixite builds from source with the shared TheRock ROCm 10.0 SDK for `gfx1151`
Strixite builds from source with the shared TheRock ROCm 10.1 SDK for `gfx1151`
and the Zen 5 host CPU. It ships `strix_server` (the default entry point),
`convert_qwen4exp`, `convert_ngram_table`, `transcode_ngram_table`, `inspect_strixw`
and `check_stream_calls`. Supply the upstream `.strixw` weights, tokenizer and