llm-d repositories
Trending repositories tagged llm-d, ranked by trending score. Updated daily.
-
1
llm-d-incubation/llm-d-fast-model-actuation
Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping
GitHub · Go · 28 stars · 28 forks · 0 stars in 24 hours · Trending score 0.25
-
2
redhat-performance/configiq
Distributed inference configuration tools
GitHub · TypeScript · 23 stars · 13 forks · 0 stars in 24 hours · Trending score 0.09
-
3
axem-solutions/shaide
Self-hosted, distributed, multi-model LLM inference
GitHub · Go · 42 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00