lmcache repositories
Trending repositories tagged lmcache, ranked by trending score. Updated daily.
-
1
Dami-wq-k03/nano-lmcache
📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Python to GPU tensors and vLLM integration. Inspired by LMCache.
GitHub · Python · 43 stars · 13 forks · 0 stars in 24 hours · Trending score 0.64
-
2
xcena-dev/maru
High-Performance KV Cache Storage Engine on CXL Shared Memory for LLM Inference
GitHub · Python · 67 stars · 6 forks · 0 stars in 24 hours · Trending score 0.09
-
3
adrienbrault/qwen3.8-27b-rtx5090
Qwen3.8-27B on 2× RTX 5090 · 1.49M KV · code/prose t/s: c1 264/216, c16 2,649/2,240 · NVFP4 + vLLM + MTP
GitHub · Shell · 25 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00