vllm-serve repositories
Trending repositories tagged vllm-serve, ranked by trending score. Updated daily.
-
1
DomynAI/domyn-swarm
Platform-agnostic toolkit to spin up vLLM endpoints and submit high-throughput jobs (DataFrame or scripts) across Slurm and DGX Cloud Lepton.
GitHub · Python · 29 stars · 2 forks · +1 stars in 24 hours · Trending score 0.61
-
2
WestWaters/pollard-weights
A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flash. Ships the residency calculator, measurement harnesses, and the build recipes behind it. Predictions validated against public benchmarks.
GitHub · Python · 34 stars · 7 forks · +1 stars in 24 hours · Trending score 0.45
-
3
AI-native-Systems-Research/scratchy
Inference serving... from scratch
GitHub · Rust · 6 stars · 5 forks · 0 stars in 24 hours · Trending score 0.09
-
4
IBM/vLLM-Hook
Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM
GitHub · Python · 172 stars · 38 forks · 0 stars in 24 hours · Trending score 0.07