feat(strata): Add ROCm 10 build for gfx1151

This commit is contained in:
2026-11-12 21:28:24 +03:00
parent 24195451db
commit a30c7d6c3a
5 changed files with 157 additions and 0 deletions
+16
View File
@@ -43,6 +43,7 @@ A custom Nix overlay and flake providing additional packages not found in upstre
| `gufo` | Gufo with XDNA2 NPU support and the Unsloth UD 3.1 compatibility patch | AI Inference |
| `xrt-amdxdna` | XRT with the amdxdna plugin, built against gufo's nixpkgs | AI Inference |
| `therock-rocm` | TheRock 10.0 SDK for gfx1151 | AI Inference |
| `strata` | Strata inference engine, API server and CPU vision encoder with ROCm 10 HIP support for gfx1151 | AI Inference |
| `pwilkin-llama-cpp` | pwilkin llama.cpp fork with ROCm for gfx1151 | AI Inference |
| `strix-llama-cpp` | halo-box llama.cpp fork with Vulkan | AI Inference |
| `loop` | Corporate messenger for your team | Communication |
@@ -133,6 +134,21 @@ The consumer must configure NPU power and fabric clocks before using the NPU.
TheRock and XRT use individual recipes from the pinned `nix-strix-halo` source
tree. Its flake and Thunderbolt dependencies are not loaded.
Strata ships `strata` (the HIP engine), `strata-server` (the OpenAI/Anthropic HTTP
server, also the default for `nix run .#strata`) and `strata-vision` (CPU image
encoder). It uses the shared TheRock ROCm 10.0 SDK, compiles GPU kernels only for
`gfx1151`, and uses upstream's portable AVX2 CPU baseline. Model weights and vision
projectors are supplied separately.
Run `nix run .#strata -- --help` for server options, or invoke the engine directly
with `nix shell .#strata -c strata --help`. For inference, pass
`strata-server --engine strata --config /path/to/strata.json`; the upstream
[server configuration](https://github.com/Niko1221/Strata/blob/v0.2.13/serve/server.py)
uses `exe`, `args`, `cwd`, `tokenizer` and `model_name`. Set `exe` to the packaged
`strata` executable and use writable model/log paths outside the Nix store.
The ROCm 7.14.1 hipBLASLt tuning table from the reference recipe is not enabled
with ROCm 10; the engine falls back to hipBLAS when no matching table is supplied.
### nftablesbuilder Runtime Notes
`nftablesbuilder` is a web interface for managing nftables. It consists of a