PyTorch in the Nix env is CPU-only, so the bundled omnivoice.cpp runtime (ggml Vulkan) is the only GPU path. Put vulkan-tools on the backend PATH: the app finds the adapter by running `vulkaninfo` and otherwise reports none, since NixOS has no FHS library directories for its fallback probe. Default OMNIVOICE_GGUF_BACKEND=vulkan so the runtime opens the GPU or fails loudly instead of falling back to the CPU. Overridable. Refs: nix-overlay-ltr
This commit is contained in:
@@ -58,7 +58,7 @@ A custom Nix overlay and flake providing additional packages not found in upstre
|
||||
| `relay-free-llm` | RESTful API to route user prompts to various AI model providers with automatic failover and intent-based routing | AI LLM Gateway |
|
||||
| `stakpak` | DevOps AI agent that generates infrastructure code, debugs Kubernetes, configures CI/CD, and automates deployments | AI Agents |
|
||||
| `traycer` | Open-source AI orchestration app for agentic coding | AI Coding Agents |
|
||||
| `voicestudio` | Fully-local voice studio — cloning, design, dubbing, dictation, transcription and audiobook creation in 646 languages; Python backend built by Nix (CPU torch), no runtime download on first launch | AI Audio |
|
||||
| `voicestudio` | Fully-local voice studio — cloning, design, dubbing, dictation, transcription and audiobook creation in 646 languages; Python backend built by Nix (CPU torch, GGUF engine pinned to Vulkan), no runtime download on first launch | AI Audio |
|
||||
|
||||
## Usage
|
||||
|
||||
|
||||
Reference in New Issue
Block a user