model-server repositories
Trending repositories tagged model-server, ranked by trending score. Updated daily.
-
1
llm-d/llm-d
State of the art inference performance with modern accelerators on Kubernetes
GitHub · Python · 5,332 stars · 953 forks · +14 stars in 24 hours · Trending score 2.59
-
2
julianmb/halofpx
High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.
GitHub · Python · 96 stars · 4 forks · +2 stars in 24 hours · Trending score 0.72