model-server repositories

Trending repositories tagged model-server, ranked by trending score. Updated daily.

  1. 1
    llm-d/llm-d

    State of the art inference performance with modern accelerators on Kubernetes

    GitHub · Python · 5,332 stars · 953 forks · +14 stars in 24 hours · Trending score 2.59

  2. 2
    julianmb/halofpx

    High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.

    GitHub · Python · 96 stars · 4 forks · +2 stars in 24 hours · Trending score 0.72