quantization-aware-training repositories

Trending repositories tagged quantization-aware-training, ranked by trending score. Updated daily.

  1. 1
    AI-Efficiency/Awesome-Model-Quantization

    A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.

    GitHub · 2,470 stars · 246 forks · 0 stars in 24 hours · Trending score 0.86

  2. 2
    openvinotoolkit/nncf

    Neural Network Compression Framework for enhanced OpenVINO™ inference

    GitHub · Python · 1,222 stars · 317 forks · 0 stars in 24 hours · Trending score 0.60

  3. 3
    hafizradzi8901/bitnet-rwkv-lm

    From-scratch 0.15B BitNet 1.58-bit (ternary) RWKV-7 LLM trained on an 8GB GPU — QAT, 2-bit packing, RFT, local chat app.

    GitHub · Python · 10 stars · 0 forks · 0 stars in 24 hours · Trending score 0.14

  4. 4
    intel/neural-compressor

    SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

    GitHub · Python · 2,730 stars · 333 forks · 0 stars in 24 hours · Trending score 0.03

  5. 5
    IST-DASLab/disaggregated-quantization

    Disaggregated quantization official codebase

    GitHub · Jupyter Notebook · 32 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  6. 6
    vincentcounathe/quasar-qat

    QUASAR: Lowering the Loss Floor of Quantization-Aware Training with Loss-Aware Reconstruction

    GitHub · Python · 13 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00