feat(strata): Add ROCm 10 build for gfx1151
This commit is contained in:
@@ -43,6 +43,7 @@ A custom Nix overlay and flake providing additional packages not found in upstre
|
||||
| `gufo` | Gufo with XDNA2 NPU support and the Unsloth UD 3.1 compatibility patch | AI Inference |
|
||||
| `xrt-amdxdna` | XRT with the amdxdna plugin, built against gufo's nixpkgs | AI Inference |
|
||||
| `therock-rocm` | TheRock 10.0 SDK for gfx1151 | AI Inference |
|
||||
| `strata` | Strata inference engine, API server and CPU vision encoder with ROCm 10 HIP support for gfx1151 | AI Inference |
|
||||
| `pwilkin-llama-cpp` | pwilkin llama.cpp fork with ROCm for gfx1151 | AI Inference |
|
||||
| `strix-llama-cpp` | halo-box llama.cpp fork with Vulkan | AI Inference |
|
||||
| `loop` | Corporate messenger for your team | Communication |
|
||||
@@ -133,6 +134,21 @@ The consumer must configure NPU power and fabric clocks before using the NPU.
|
||||
TheRock and XRT use individual recipes from the pinned `nix-strix-halo` source
|
||||
tree. Its flake and Thunderbolt dependencies are not loaded.
|
||||
|
||||
Strata ships `strata` (the HIP engine), `strata-server` (the OpenAI/Anthropic HTTP
|
||||
server, also the default for `nix run .#strata`) and `strata-vision` (CPU image
|
||||
encoder). It uses the shared TheRock ROCm 10.0 SDK, compiles GPU kernels only for
|
||||
`gfx1151`, and uses upstream's portable AVX2 CPU baseline. Model weights and vision
|
||||
projectors are supplied separately.
|
||||
|
||||
Run `nix run .#strata -- --help` for server options, or invoke the engine directly
|
||||
with `nix shell .#strata -c strata --help`. For inference, pass
|
||||
`strata-server --engine strata --config /path/to/strata.json`; the upstream
|
||||
[server configuration](https://github.com/Niko1221/Strata/blob/v0.2.13/serve/server.py)
|
||||
uses `exe`, `args`, `cwd`, `tokenizer` and `model_name`. Set `exe` to the packaged
|
||||
`strata` executable and use writable model/log paths outside the Nix store.
|
||||
The ROCm 7.14.1 hipBLASLt tuning table from the reference recipe is not enabled
|
||||
with ROCm 10; the engine falls back to hipBLAS when no matching table is supplied.
|
||||
|
||||
### nftablesbuilder Runtime Notes
|
||||
|
||||
`nftablesbuilder` is a web interface for managing nftables. It consists of a
|
||||
|
||||
Reference in New Issue
Block a user