kvcache repositories

Trending repositories tagged kvcache, ranked by trending score. Updated daily.

  1. 1
    kvcache-ai/Mooncake

    Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

    GitHub · C++ · 7,088 stars · 1,507 forks · +22 stars in 24 hours · Trending score 2.80

  2. 2
    ModelEngine-Group/unified-cache-management

    Persist and reuse KV Cache to speedup your LLM.

    GitHub · C++ · 360 stars · 138 forks · +2 stars in 24 hours · Trending score 1.18

  3. 3
    uccl-project/uccl

    UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

    GitHub · C++ · 1,588 stars · 199 forks · +2 stars in 24 hours · Trending score 1.12

  4. 4
    alibaba/tair-kvcache

    Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSim), and more.

    GitHub · C++ · 283 stars · 69 forks · 0 stars in 24 hours · Trending score 0.23

  5. 5
    ovg-project/kvcached

    Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

    GitHub · Python · 2,051 stars · 243 forks · 0 stars in 24 hours · Trending score 0.03

  6. 6
    Zefan-Cai/R-KV

    [Neurips 2025] R-KV: Redundancy-aware KV Cache Compression for Reasoning Models

    GitHub · Python · 1,214 stars · 196 forks · 0 stars in 24 hours · Trending score 0.00