llm-d repositories

Trending repositories tagged llm-d, ranked by trending score. Updated daily.

  1. 1
    llm-d-incubation/llm-d-fast-model-actuation

    Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping

    GitHub · Go · 28 stars · 28 forks · 0 stars in 24 hours · Trending score 0.25

  2. 2
    redhat-performance/configiq

    Distributed inference configuration tools

    GitHub · TypeScript · 23 stars · 13 forks · 0 stars in 24 hours · Trending score 0.09

  3. 3
    axem-solutions/shaide

    Self-hosted, distributed, multi-model LLM inference

    GitHub · Go · 42 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00