serving-infrastructure repositories

Trending repositories tagged serving-infrastructure, ranked by trending score. Updated daily.

  1. 1
    NetX-lab/Frontier

    Frontier: A Discrete-Event Simulator for Modern LLM Serving

    GitHub · Python · 185 stars · 29 forks · +5 stars in 24 hours · Trending score 1.41

  2. 2
    mstar-project/mstar

    A high-performance, universal serving framework for any-to-any models.

    GitHub · Python · 117 stars · 50 forks · 0 stars in 24 hours · Trending score 0.45

  3. 3
    sgyaqing/verdict

    A high-performance serving engine for System One decision models.

    GitHub · Rust · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.02