strix-halo repositories
Trending repositories tagged strix-halo, ranked by trending score. Updated daily.
-
1
mw00/project-maya
Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash (220B) on your own GPUs - from 8 GB of VRAM, NVIDIA and AMD, one dashboard, OpenAI- and Anthropic-compatible API.
GitHub · C++ · 3,127 stars · 435 forks · +92 stars in 24 hours · Trending score 3.80
-
2
gufo-org/gufo
The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary, with OpenAI-compatible APIs, caching for coding agents and model extensions. Linux and Windows.
GitHub · C++ · 1,233 stars · 211 forks · +18 stars in 24 hours · Trending score 2.65
-
3
peonist-ai/halogen-flash-server
Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
GitHub · Shell · 1,408 stars · 103 forks · +17 stars in 24 hours · Trending score 2.61
-
4
rulith-dev/rulith-inference
Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a manager, and a desktop app.
GitHub · Python · 56 stars · 6 forks · +22 stars in 24 hours · Trending score 2.30
-
5
Soulmate-Halo/heterogeneous-gpu-pd-lab
使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。
GitHub · C++ · 1,286 stars · 203 forks · +8 stars in 24 hours · Trending score 2.25
-
6
Osmantic/ODS
ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
GitHub · Python · 7,861 stars · 1,120 forks · +8 stars in 24 hours · Trending score 2.16
-
7
Nathanw1014/strix-halo-llamacpp
Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.
GitHub · Python · 227 stars · 21 forks · +16 stars in 24 hours · Trending score 2.00
-
8
IIIIIllllIIIIIlllll/Qwenox
An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架,Linux和Windows通用,只能部署qwen3.8-flash-next。本项目仅供参考学习使用。
GitHub · C++ · 150 stars · 31 forks · +5 stars in 24 hours · Trending score 1.38
-
9
Yamz-Labs/kyojin
Kyojin: open-source engine that runs 100 GB-class open models (GLM-5.3, Qwen3.8, DeepSeek V4.1) on one desktop machine. AMD Strix Halo, NVIDIA RTX and Apple Mac. OpenAI API, built on ExLlamaV3.
GitHub · Python · 245 stars · 39 forks · +3 stars in 24 hours · Trending score 1.32
-
10
hyukudan/strix-halo-engine-lab
Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; DeepSeek V4.1 Flash across two nodes over USB4 with an optional RTX PRO. Speculative decoding bit-identical to greedy, up to 255 tok/s on coding chat. MiniMax and GLM next.
GitHub · C++ · 38 stars · 6 forks · +2 stars in 24 hours · Trending score 1.26
-
11
jaedync/crucible-strix-halo
Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-compatible server, 4 sessions of 262K context, setup guide included.
GitHub · Python · 35 stars · 7 forks · 0 stars in 24 hours · Trending score 0.79
-
12
franzmoca/ds41-gufo-extension
DeepSeek V4.1 Flash for Gufo on AMD Strix Halo: DSpark drafting, vision, tool calls and SSD expert streaming
GitHub · C++ · 7 stars · 2 forks · +1 stars in 24 hours · Trending score 0.73
-
13
SnowLLM/SnowLLM
Your Ryzen AI Max is running at half speed. SnowLLM: up to 9x faster prefill and 2x faster decode than llama.cpp on the same GGUF. Qwen3.6-35B-A3B, Qwen3.8-Flash-Next, DeepSeek-V4-Flash.
GitHub · Python · 21 stars · 2 forks · 0 stars in 24 hours · Trending score 0.57
-
14
1bit-MONSTER/engine
One binary to rule them all: model-agnostic local LLM inference for AMD Strix Halo (Ryzen AI MAX+ 395) on Linux. Radeon 8060S iGPU (gfx1151) via HRX + our HIP kernels, XDNA 2 NPU via our NPU runtime, inside Lemonade Server with an OpenAI-compatible API. Qwen3.8, ZAYA1, BitNet b1.58, any GGUF. Apache-2.0.
GitHub · C++ · 10 stars · 2 forks · 0 stars in 24 hours · Trending score 0.38
-
15
julianmb/haloq38flash
qwen3.8-flash-next on strix halo — 91g quant, 56 tok/s, 262k context, receipts included
GitHub · Shell · 28 stars · 2 forks · 0 stars in 24 hours · Trending score 0.32
-
16
pepuscz/strix-halo-llm
DeepSeek-V4.1-Flash (1M context) and GLM-5.3-Flash on a BOSGAME M5 (Ryzen AI Max+ 395, Radeon 8060S, 128 GiB) with two RX 7900 XTX over OCuLink: pinned Ansible recipes and measured results. Also the M5-only Qwen and DeepSeek setups.
GitHub · Python · 31 stars · 2 forks · 0 stars in 24 hours · Trending score 0.29
-
17
Hal0ai/hal0
Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.
GitHub · Python · 87 stars · 12 forks · 0 stars in 24 hours · Trending score 0.24
-
18
ciru-ai/ComfyUI-CiruImageAccelerator
Qwen Image 2.1 Turbo Prediction and Strix Halo attention for ComfyUI
GitHub · Python · 18 stars · 0 forks · 0 stars in 24 hours · Trending score 0.14
-
19
aic0d3r/local-ai-harness
Local AI harness for coding agents: detects your GPU and RAM, recommends an engine and model, sizes limits to your context. Any OpenAI-compatible engine or cloud model. Tuned for AMD Strix Halo.
GitHub · Python · 38 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09
-
20
KyaniteLabs/qwen38-27b-strix-halo
Qwen 3.8 27B on a $1,400 Strix Halo: frozen optimal config, 262k needle-exact retrieval, vision fixed, delegation-card certified
GitHub · Python · 14 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07
-
21
ciru-ai/Qwen3.8-Flash-CIRU-STRIX-IU4
CIRU llama.cpp runtime for Qwen3.8-Flash-CIRU-STRIX-IU4 on AMD Strix Halo
GitHub · C++ · 22 stars · 3 forks · 0 stars in 24 hours · Trending score 0.03
-
22
hogeheer499-commits/strix-halo-guide
Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.
GitHub · Python · 371 stars · 27 forks · 0 stars in 24 hours · Trending score 0.02
-
23
tsaipifong/whirl-llm
WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and Radeon AI PRO R9700. Unzip and run, only the AMD driver.
GitHub · C++ · 39 stars · 3 forks · 0 stars in 24 hours · Trending score 0.02
-
24
peppeg/Lemonade_Control_Center
Browser-based operator console for managing and monitoring Lemonade on Linux inference servers.
GitHub · Python · 23 stars · 3 forks · 0 stars in 24 hours · Trending score 0.01