post-training-quantization repositories

Trending repositories tagged post-training-quantization, ranked by trending score. Updated daily.

  1. 1
    IST-DASLab/GSQ

    Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).

    GitHub · Python · 143 stars · 21 forks · 0 stars in 24 hours · Trending score 1.38

  2. 2
    AI-Efficiency/Awesome-Model-Quantization

    A curated collection of papers, benchmarks, surveys, and tools for model quantization, covering low-bit networks, LLMs, multimodal and generative models, vector and lattice quantization, and efficient deployment.

    GitHub · 2,470 stars · 246 forks · 0 stars in 24 hours · Trending score 0.86

  3. 3
    pjmalandrino/llvq

    Tetra : Leech lattice vector quantization for 2-bit LLM weights, in Rust, with a fused multi-shell CUDA decoder.

    GitHub · Rust · 5 stars · 1 forks · 0 stars in 24 hours · Trending score 0.18

  4. 4
    intel/neural-compressor

    SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

    GitHub · Python · 2,730 stars · 333 forks · 0 stars in 24 hours · Trending score 0.03

  5. 5
    Dreamer-Toby/STEPQuant

    STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization

    GitHub · Python · 102 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00