serving-infrastructure repositories
Trending repositories tagged serving-infrastructure, ranked by trending score. Updated daily.
-
1
NetX-lab/Frontier
Frontier: A Discrete-Event Simulator for Modern LLM Serving
GitHub · Python · 185 stars · 29 forks · +5 stars in 24 hours · Trending score 1.41
-
2
mstar-project/mstar
A high-performance, universal serving framework for any-to-any models.
GitHub · Python · 117 stars · 50 forks · 0 stars in 24 hours · Trending score 0.45
-
3
sgyaqing/verdict
A high-performance serving engine for System One decision models.
GitHub · Rust · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.02