lmcache repositories

Trending repositories tagged lmcache, ranked by trending score. Updated daily.

  1. 1
    Dami-wq-k03/nano-lmcache

    📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Python to GPU tensors and vLLM integration. Inspired by LMCache.

    GitHub · Python · 43 stars · 13 forks · 0 stars in 24 hours · Trending score 0.64

  2. 2
    xcena-dev/maru

    High-Performance KV Cache Storage Engine on CXL Shared Memory for LLM Inference

    GitHub · Python · 67 stars · 6 forks · 0 stars in 24 hours · Trending score 0.09

  3. 3
    adrienbrault/qwen3.8-27b-rtx5090

    Qwen3.8-27B on 2× RTX 5090 · 1.49M KV · code/prose t/s: c1 264/216, c16 2,649/2,240 · NVFP4 + vLLM + MTP

    GitHub · Shell · 25 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00