serving-ml repositories
Trending repositories tagged serving-ml, ranked by trending score. Updated daily.
-
1
clearml/clearml-serving
ClearML - Model-Serving Orchestration and Repository Solution
GitHub · Python · 170 stars · 54 forks · 0 stars in 24 hours · Trending score 0.08
-
2
hpnkv/a11
A streaming action runtime for AI agents, model serving, and multimodal APIs
GitHub · C++ · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06
-
3
jjiantong/Awesome-KV-Cache-Optimization
[ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
GitHub · Python · 427 stars · 27 forks · 0 stars in 24 hours · Trending score 0.00
-
4
sgyaqing/verdict
A high-performance serving engine for System One decision models.
GitHub · Rust · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00