kv-cache-quantization repositories
Trending repositories tagged kv-cache-quantization, ranked by trending score. Updated daily.
-
1
jaylfc/taOS
Self-hosted AI agent OS. Your memory, chat, agents, and files stay on hardware you own, offline by default, cloud by choice. Offline AI memory (taOSmd), self-hosted multi-framework group chat, a full web desktop + app store, and auto-clustering across the consumer hardware you already have (Orange/Raspberry Pi, Mac mini, gaming PC).
GitHub · Python · 610 stars · 47 forks · +3 stars in 24 hours · Trending score 0.99
-
2
AI-Efficiency/Awesome-Model-Quantization
A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.
GitHub · 2,470 stars · 246 forks · 0 stars in 24 hours · Trending score 0.86
-
3
OpenBitSys/BitDecoding-FP4
Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.
GitHub · Python · 40 stars · 3 forks · 0 stars in 24 hours · Trending score 0.53
-
4
mscheong01/TaSQ
Official code for paper "Tailoring the Quantization Space for 1-Bit KV Cache Compression"
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00