GitHub · Python
ovg-project/kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
- Stars
- 2,053
- Forks
- 244
- Stars gained in 24 hours
- +1
- Forks gained in 24 hours
- 0
Topics: gpu-sharing, kvcache, llm, sglang, vllm, kvcached, inference-engine, gpu-mutiplexing, kvcache-optimization, llm-framework
Latest data point: Nov 22, 2026 · 2,053 stars · 244 forks