serving-ml repositories

Trending repositories tagged serving-ml, ranked by trending score. Updated daily.

  1. 1
    clearml/clearml-serving

    ClearML - Model-Serving Orchestration and Repository Solution

    GitHub · Python · 170 stars · 54 forks · 0 stars in 24 hours · Trending score 0.08

  2. 2
    hpnkv/a11

    A streaming action runtime for AI agents, model serving, and multimodal APIs

    GitHub · C++ · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06

  3. 3
    jjiantong/Awesome-KV-Cache-Optimization

    [ACL 2026] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

    GitHub · Python · 427 stars · 27 forks · 0 stars in 24 hours · Trending score 0.00

  4. 4
    sgyaqing/verdict

    A high-performance serving engine for System One decision models.

    GitHub · Rust · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00