rocm repositories
Trending repositories tagged rocm, ranked by trending score. Updated daily.
-
1
mw00/project-maya
Run GLM-5.3 (744B), DeepSeek-V4.1-Flash (748B), MiniMax-M3.1-Flash (428B), GLM-5.3-Flash (321B) and Hy4-Flash (220B) on your own GPUs - from 8 GB of VRAM, NVIDIA and AMD, one dashboard, OpenAI- and Anthropic-compatible API.
GitHub · C++ · 3,094 stars · 430 forks · +69 stars in 24 hours · Trending score 3.63
-
2
wici-ai/inferssd
Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
GitHub · C++ · 1,262 stars · 113 forks · +32 stars in 24 hours · Trending score 3.48
-
3
peonist-ai/halogen-flash-server
Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
GitHub · Shell · 1,403 stars · 101 forks · +17 stars in 24 hours · Trending score 2.66
-
4
LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
GitHub · Python · 12,398 stars · 2,174 forks · +18 stars in 24 hours · Trending score 2.63
-
5
SemiAnalysisAI/InferenceX
Open Source AI Accelerator Research Platform Standard / 开源推理研究平台
GitHub · Python · 2,069 stars · 382 forks · +15 stars in 24 hours · Trending score 2.47
-
6
gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
GitHub · Python · 6,086 stars · 746 forks · +11 stars in 24 hours · Trending score 2.42
-
7
tracel-ai/burn
Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.
GitHub · Rust · 16,313 stars · 1,135 forks · +14 stars in 24 hours · Trending score 2.41
-
8
lemonade-sdk/lemonade
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
GitHub · C++ · 6,253 stars · 571 forks · +8 stars in 24 hours · Trending score 2.23
-
9
hiruhiru2005/sync-strata
A one-click local LLM app for Windows and Linux: Qwen3.8-Flash-Next with the Sync quantizations (XS, S, M), based on Strata.
GitHub · C++ · 69 stars · 5 forks · +48 stars in 24 hours · Trending score 2.14
-
10
ahtx/kindi
Kindi 0.6.1: fast local LLM inference on low-cost GPUs and CPUs. DeepSeek-V4.1-Flash (552B) at 18.7 tok/s on one RTX 3060 12 GB with a dual-Xeon DDR4 server. Ternary Bonsai 2B-27B, AH-Nanbeige4.3-33B, Nemotron 3.5 Lightning 30B-A3B. NVIDIA from the Quadro K420 to the RTX 50 series, AMD Radeon graphics, Windows and Linux. OpenAI-compatible server.
GitHub · Python · 195 stars · 41 forks · +6 stars in 24 hours · Trending score 1.95
-
11
AMD-AGI/Hyperloom
An agentic system that auto-optimizes LLM workloads on AMD GPUs.
GitHub · Python · 282 stars · 89 forks · +7 stars in 24 hours · Trending score 1.88
-
12
stew675/llama-cpp-rdna-boosts
A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance
GitHub · Shell · 272 stars · 24 forks · +6 stars in 24 hours · Trending score 1.86
-
13
warpfront/hipfire
RDNA-native LLM inference engine in Rust.
GitHub · Rust · 819 stars · 109 forks · +5 stars in 24 hours · Trending score 1.64
-
14
Luce-Org/lucebox
Lucebox inference engine for heterogeneous hardware & consumer GPUs
GitHub · C++ · 3,018 stars · 299 forks · +3 stars in 24 hours · Trending score 1.63
-
15
iree-org/iree
A retargetable MLIR-based machine learning compiler and runtime toolkit.
GitHub · C++ · 4,023 stars · 1,064 forks · +4 stars in 24 hours · Trending score 1.61
-
16
SlyBase/vllm-sly-radiance
Working on the fastest vllm path for AMD Radeon AI PRO R9700
GitHub · Python · 117 stars · 11 forks · +6 stars in 24 hours · Trending score 1.49
-
17
hyukudan/strix-halo-engine-lab
Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; DeepSeek V4.1 Flash across two nodes over USB4 with an optional RTX PRO. Speculative decoding bit-identical to greedy, up to 255 tok/s on coding chat. MiniMax and GLM next.
GitHub · C++ · 37 stars · 6 forks · +4 stars in 24 hours · Trending score 1.48
-
18
jaedync/crucible-strix-halo
Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-compatible server, 4 sessions of 262K context, setup guide included.
GitHub · Python · 35 stars · 7 forks · +2 stars in 24 hours · Trending score 1.45
-
19
IIIIIllllIIIIIlllll/Qwenox
An inference framework customized for AI MAX 395, compatible with both Linux and Windows, and supports deploying only qwen3.8-flash-next. This project is for reference and learning purposes only. 为AI MAX 395定制的推理框架,Linux和Windows通用,只能部署qwen3.8-flash-next。本项目仅供参考学习使用。
GitHub · C++ · 149 stars · 31 forks · +5 stars in 24 hours · Trending score 1.45
-
20
Motphys/Uni-SuperMimic
SuperMimic-UniLab: An Independent reproduction of SuperMimic on UniLab for whole-body humanoid motion tracking.
GitHub · Python · 312 stars · 25 forks · +1 stars in 24 hours · Trending score 1.21
-
21
ROCm/AMDMIGraphX
AMD's graph optimization engine.
GitHub · C++ · 341 stars · 168 forks · +2 stars in 24 hours · Trending score 1.19
-
22
JMS1717/ming-voice
Low-latency local speech-to-speech voice assistant with Ming-3.0-audio-tiny on AMD and Nvidia GPUs. Easy setup on Windows and Linux
GitHub · Python · 450 stars · 26 forks · +3 stars in 24 hours · Trending score 1.15
-
23
ModelCloud/GPTQModel
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
GitHub · Python · 1,294 stars · 220 forks · +2 stars in 24 hours · Trending score 1.11
-
24
pantheongpu/pantheonsim
PantheonSim: GPU simulator for CUDA and ROCm. Run CUDA and HIP programs unmodified on a CPU, no GPU needed: simulated NVIDIA and AMD GPUs for development, teaching and CI.
GitHub · C++ · 42 stars · 7 forks · +1 stars in 24 hours · Trending score 0.97