kv-cache-quantization repositories

Trending repositories tagged kv-cache-quantization, ranked by trending score. Updated daily.

  1. 1
    jaylfc/taOS

    Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).

    GitHub · Python · 610 stars · 47 forks · +3 stars in 24 hours · Trending score 0.99

  2. 2
    AI-Efficiency/Awesome-Model-Quantization

    A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.

    GitHub · 2,470 stars · 246 forks · 0 stars in 24 hours · Trending score 0.86

  3. 3
    OpenBitSys/BitDecoding-FP4

    Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.

    GitHub · Python · 40 stars · 3 forks · 0 stars in 24 hours · Trending score 0.53

  4. 4
    mscheong01/TaSQ

    Official code for paper "Tailoring the Quantization Space for 1-Bit KV Cache Compression"

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00