kv-cache-compression repositories
Trending repositories tagged kv-cache-compression, ranked by trending score. Updated daily.
-
1
NVIDIA/kvpress
LLM KV cache compression made easy
GitHub · Python · 1,255 stars · 201 forks · 0 stars in 24 hours · Trending score 0.75
-
2
aivrar/vllm-windows-build
Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the Releases page. PyTorch 2.14, FlashAttention/Rust, OpenAI serving, 10 KV formats, Multi-TurboQuant, experimental CPU/NVMe KV offload. No WSL or Docker.
GitHub · Python · 68 stars · 9 forks · 0 stars in 24 hours · Trending score 0.53
-
3
rajveer43/VeloxQuant-MLX
Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels
GitHub · Python · 36 stars · 11 forks · 0 stars in 24 hours · Trending score 0.23
-
4
datasound-projects/Promptboard
Local-first workspace for CLI coding agents: plan projects in Origin, engineer prompts in Compose, run tasks on Kanban and reuse agentic AI resources in Base.
GitHub · JavaScript · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.01
-
5
mscheong01/TaSQ
Official code for paper "Tailoring the Quantization Space for 1-Bit KV Cache Compression"
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00