vllm-serve repositories

Trending repositories tagged vllm-serve, ranked by trending score. Updated daily.

  1. 1
    DomynAI/domyn-swarm

    Platform-agnostic toolkit to spin up vLLM endpoints and submit high-throughput jobs (DataFrame or scripts) across Slurm and DGX Cloud Lepton.

    GitHub · Python · 29 stars · 2 forks · +1 stars in 24 hours · Trending score 0.61

  2. 2
    WestWaters/pollard-weights

    A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flash. Ships the residency calculator, measurement harnesses, and the build recipes behind it. Predictions validated against public benchmarks.

    GitHub · Python · 34 stars · 7 forks · +1 stars in 24 hours · Trending score 0.45

  3. 3
    AI-native-Systems-Research/scratchy

    Inference serving... from scratch

    GitHub · Rust · 6 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09

  4. 4
    IBM/vLLM-Hook

    Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM

    GitHub · Python · 172 stars · 38 forks · 0 stars in 24 hours · Trending score 0.07