feat(strixite): Add ROCm 10 build for gfx1151

This commit is contained in:
2026-11-12 21:57:26 +03:00
parent 3d04ce81ad
commit 00dc8c2c8c
5 changed files with 140 additions and 0 deletions
+19
View File
@@ -45,6 +45,7 @@ A custom Nix overlay and flake providing additional packages not found in upstre
| `therock-rocm` | TheRock 10.0 SDK for gfx1151 | AI Inference |
| `strata` | Strata inference engine, API server and CPU vision encoder with ROCm 10 HIP support for gfx1151 | AI Inference |
| `crucible-strix-halo` | Crucible EXL3 inference engine and OpenAI-compatible server for gfx1151 with the ROCm 10 runtime | AI Inference |
| `strixite` | Source-built HIP inference engine and OpenAI-compatible server for gfx1151 / Zen 5 with ROCm 10 | AI Inference |
| `pwilkin-llama-cpp` | pwilkin llama.cpp fork with ROCm for gfx1151 | AI Inference |
| `strix-llama-cpp` | halo-box llama.cpp fork with Vulkan | AI Inference |
| `loop` | Corporate messenger for your team | Communication |
@@ -168,6 +169,24 @@ is not included. Model downloads and conversation state belong outside the Nix
store. See the upstream [setup guide](https://github.com/jaedync/crucible-strix-halo/blob/v0.37.0/docs/QUICKSTART.md)
for GPU memory configuration and model requirements.
Strixite builds from source with the shared TheRock ROCm 10.0 SDK for `gfx1151`
and the Zen 5 host CPU. It ships `strix_server` (the default entry point),
`convert_qwen4exp`, `convert_ngram_table`, `transcode_ngram_table`, `inspect_strixw`
and `check_stream_calls`. Supply the upstream `.strixw` weights, tokenizer and
n-gram table separately, following the [model setup](https://github.com/shawnshekari/strixite/tree/v0.7.0#quick-start).
```bash
STRIX_MODELS_DIR=/path/to/models nix run .#strixite -- --host 127.0.0.1
```
The default port is 5300. `strix_server --help` lists all settings; the commented
upstream configuration is installed at `share/strixite/strix-server.conf`.
Model and prompt-cache paths stay outside the Nix store. The upstream defaults
assume a dedicated 128 GB machine; see its [memory guide](https://github.com/shawnshekari/strixite/blob/v0.7.0/docs/memory.md)
when sharing the GPU with a desktop or another model.
`nix run .#strixite.tests.gpu` builds and runs the upstream kernel tutorial's
CPU/GPU correctness checks on a machine with GPU access.
### nftablesbuilder Runtime Notes
`nftablesbuilder` is a web interface for managing nftables. It consists of a