kvcache repositories
Trending repositories tagged kvcache, ranked by trending score. Updated daily.
-
1
kvcache-ai/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
GitHub · C++ · 7,088 stars · 1,507 forks · +22 stars in 24 hours · Trending score 2.80
-
2
ModelEngine-Group/unified-cache-management
Persist and reuse KV Cache to speedup your LLM.
GitHub · C++ · 360 stars · 138 forks · +2 stars in 24 hours · Trending score 1.18
-
3
uccl-project/uccl
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
GitHub · C++ · 1,588 stars · 199 forks · +2 stars in 24 hours · Trending score 1.12
-
4
alibaba/tair-kvcache
Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.
GitHub · C++ · 283 stars · 69 forks · 0 stars in 24 hours · Trending score 0.23
-
5
ovg-project/kvcached
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
GitHub · Python · 2,051 stars · 243 forks · 0 stars in 24 hours · Trending score 0.03
-
6
Zefan-Cai/R-KV
[Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
GitHub · Python · 1,214 stars · 196 forks · 0 stars in 24 hours · Trending score 0.00