kv-cache-compression repositories

Trending repositories tagged kv-cache-compression, ranked by trending score. Updated daily.

  1. 1
    NVIDIA/kvpress

    LLM KV cache compression made easy

    GitHub · Python · 1,255 stars · 201 forks · 0 stars in 24 hours · Trending score 0.75

  2. 2
    aivrar/vllm-windows-build

    Native Windows vLLM 0.33.0 (Python 3.13/CUDA 13.0), plus a Python 3.14/CUDA 13.2 build; older versions on the Releases page. PyTorch 2.14, FlashAttention/Rust, OpenAI serving, 10 KV formats, Multi-TurboQuant, experimental CPU/NVMe KV offload. No WSL or Docker.

    GitHub · Python · 68 stars · 9 forks · 0 stars in 24 hours · Trending score 0.53

  3. 3
    rajveer43/VeloxQuant-MLX

    Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels

    GitHub · Python · 36 stars · 11 forks · 0 stars in 24 hours · Trending score 0.23

  4. 4
    datasound-projects/Promptboard

    Local-first workspace for CLI coding agents: plan projects in Origin, engineer prompts in Compose, run tasks on Kanban and reuse agentic AI resources in Base.

    GitHub · JavaScript · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.01

  5. 5
    mscheong01/TaSQ

    Official code for paper "Tailoring the Quantization Space for 1-Bit KV Cache Compression"

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00