jaedync/crucible-strix-halo
EXL3 inference engine for Qwen3.8-Flash-Next on AMD Strix Halo: Ryzen AI Max+ 395, Radeon 8060S, gfx1151, ROCm/HIP in C++20. Exact speculative decoding, OpenAI-compatible server, and speed claims stated against measured hardware ceilings.
GitHub repository with 13 stars and 3 forks.
Language: C++
Topics: amd, amd-apu, cpp20, exl3, gfx1151, hip, inference-engine, llm-inference, llm-serving, local-llm