strix-halo repositories

Trending repositories tagged strix-halo, ranked by trending score. Updated daily.

  1. 1
    mw00/project-maya

    Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash (220B) on your own GPUs - from 8 GB of VRAM, NVIDIA and AMD, one dashboard, OpenAI- and Anthropic-compatible API.

    GitHub · C++ · 3,127 stars · 435 forks · +92 stars in 24 hours · Trending score 3.80

  2. 2
    gufo-org/gufo

    The open-source AI engine for AMD Strix Halo. Text, embeddings, speech, image and video models in one binary, with OpenAI-compatible APIs, caching for coding agents and model extensions. Linux and Windows.

    GitHub · C++ · 1,233 stars · 211 forks · +18 stars in 24 hours · Trending score 2.65

  3. 3
    peonist-ai/halogen-flash-server

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    GitHub · Shell · 1,408 stars · 103 forks · +17 stars in 24 hours · Trending score 2.61

  4. 4
    rulith-dev/rulith-inference

    Rulith Inference, formerly Strix Llama. Serving a 125B MoE model fast on one AMD Strix Halo machine, on Windows: a patched llama.cpp, a manager, and a desktop app.

    GitHub · Python · 56 stars · 6 forks · +22 stars in 24 hours · Trending score 2.30

  5. 5
    Soulmate-Halo/heterogeneous-gpu-pd-lab

    使用稠密算力卡对稀疏大显存主机进行加速,主机包括 AI Max+ 395、M3 512G、DGX Spark 等。

    GitHub · C++ · 1,286 stars · 203 forks · +8 stars in 24 hours · Trending score 2.25

  6. 6
    Osmantic/ODS

    ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

    GitHub · Python · 7,861 stars · 1,120 forks · +8 stars in 24 hours · Trending score 2.16

  7. 7
    Nathanw1014/strix-halo-llamacpp

    Performance-tuned llama.cpp for AMD Strix Halo (gfx1151): FA + MoE-prefill fixes with a bundled current Mesa driver. Vulkan and HIP; portable dir, Docker, and distrobox.

    GitHub · Python · 227 stars · 21 forks · +16 stars in 24 hours · Trending score 2.00

  8. 8
    IIIIIllllIIIIIlllll/Qwenox

    An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架,Linux和Windows通用,只能部署qwen3.8-flash-next。本项目仅供参考学习使用。

    GitHub · C++ · 150 stars · 31 forks · +5 stars in 24 hours · Trending score 1.38

  9. 9
    Yamz-Labs/kyojin

    Kyojin: open-source engine that runs 100 GB-class open models (GLM-5.3, Qwen3.8, DeepSeek V4.1) on one desktop machine. AMD Strix Halo, NVIDIA RTX and Apple Mac. OpenAI API, built on ExLlamaV3.

    GitHub · Python · 245 stars · 39 forks · +3 stars in 24 hours · Trending score 1.32

  10. 10
    hyukudan/strix-halo-engine-lab

    Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; DeepSeek V4.1 Flash across two nodes over USB4 with an optional RTX PRO. Speculative decoding bit-identical to greedy, up to 255 tok/s on coding chat. MiniMax and GLM next.

    GitHub · C++ · 38 stars · 6 forks · +2 stars in 24 hours · Trending score 1.26

  11. 11
    jaedync/crucible-strix-halo

    Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-compatible server, 4 sessions of 262K context, setup guide included.

    GitHub · Python · 35 stars · 7 forks · 0 stars in 24 hours · Trending score 0.79

  12. 12
    franzmoca/ds41-gufo-extension

    DeepSeek V4.1 Flash for Gufo on AMD Strix Halo: DSpark drafting, vision, tool calls and SSD expert streaming

    GitHub · C++ · 7 stars · 2 forks · +1 stars in 24 hours · Trending score 0.73

  13. 13
    SnowLLM/SnowLLM

    Your Ryzen AI Max is running at half speed. SnowLLM: up to 9x faster prefill and 2x faster decode than llama.cpp on the same GGUF. Qwen3.6-35B-A3B, Qwen3.8-Flash-Next, DeepSeek-V4-Flash.

    GitHub · Python · 21 stars · 2 forks · 0 stars in 24 hours · Trending score 0.57

  14. 14
    1bit-MONSTER/engine

    One binary to rule them all: model-agnostic local LLM inference for AMD Strix Halo (Ryzen AI MAX+ 395) on Linux. Radeon 8060S iGPU (gfx1151) via HRX + our HIP kernels, XDNA 2 NPU via our NPU runtime, inside Lemonade Server with an OpenAI-compatible API. Qwen3.8, ZAYA1, BitNet b1.58, any GGUF. Apache-2.0.

    GitHub · C++ · 10 stars · 2 forks · 0 stars in 24 hours · Trending score 0.38

  15. 15
    julianmb/haloq38flash

    qwen3.8-flash-next on strix halo — 91g quant, 56 tok/s, 262k context, receipts included

    GitHub · Shell · 28 stars · 2 forks · 0 stars in 24 hours · Trending score 0.32

  16. 16
    pepuscz/strix-halo-llm

    DeepSeek-V4.1-Flash (1M context) and GLM-5.3-Flash on a BOSGAME M5 (Ryzen AI Max+ 395, Radeon 8060S, 128 GiB) with two RX 7900 XTX over OCuLink: pinned Ansible recipes and measured results. Also the M5-only Qwen and DeepSeek setups.

    GitHub · Python · 31 stars · 2 forks · 0 stars in 24 hours · Trending score 0.29

  17. 17
    Hal0ai/hal0

    Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.

    GitHub · Python · 87 stars · 12 forks · 0 stars in 24 hours · Trending score 0.24

  18. 18
    ciru-ai/ComfyUI-CiruImageAccelerator

    Qwen Image 2.1 Turbo Prediction and Strix Halo attention for ComfyUI

    GitHub · Python · 18 stars · 0 forks · 0 stars in 24 hours · Trending score 0.14

  19. 19
    aic0d3r/local-ai-harness

    Local AI harness for coding agents: detects your GPU and RAM, recommends an engine and model, sizes limits to your context. Any OpenAI-compatible engine or cloud model. Tuned for AMD Strix Halo.

    GitHub · Python · 38 stars · 0 forks · 0 stars in 24 hours · Trending score 0.09

  20. 20
    KyaniteLabs/qwen38-27b-strix-halo

    Qwen 3.8 27B on a $1,400 Strix Halo: frozen optimal config, 262k needle-exact retrieval, vision fixed, delegation-card certified

    GitHub · Python · 14 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07

  21. 21
    ciru-ai/Qwen3.8-Flash-CIRU-STRIX-IU4

    CIRU llama.cpp runtime for Qwen3.8-Flash-CIRU-STRIX-IU4 on AMD Strix Halo

    GitHub · C++ · 22 stars · 3 forks · 0 stars in 24 hours · Trending score 0.03

  22. 22
    hogeheer499-commits/strix-halo-guide

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    GitHub · Python · 371 stars · 27 forks · 0 stars in 24 hours · Trending score 0.02

  23. 23
    tsaipifong/whirl-llm

    WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and Radeon AI PRO R9700. Unzip and run, only the AMD driver.

    GitHub · C++ · 39 stars · 3 forks · 0 stars in 24 hours · Trending score 0.02

  24. 24
    peppeg/Lemonade_Control_Center

    Browser-based operator console for managing and monitoring Lemonade on Linux inference servers.

    GitHub · Python · 23 stars · 3 forks · 0 stars in 24 hours · Trending score 0.01