low-bit-quantization repositories

Trending repositories tagged low-bit-quantization, ranked by trending score. Updated daily.

  1. 1
    OpenBitSys/BitDecoding-FP4

    Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.

    GitHub · Python · 40 stars · 3 forks · 0 stars in 24 hours · Trending score 0.71

  2. 2
    OpenBitSys/vlut.cpp

    [MobiSys 2026] On-device ultra-low-bit LLM inference with LUT

    GitHub · C++ · 29 stars · 6 forks · 0 stars in 24 hours · Trending score 0.37