gptq repositories
Trending repositories tagged gptq, ranked by trending score. Updated daily.
-
1
sergqwer/strata-nvfp4
Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU experts on AVX-512 or AVX2 (+AVX-VNNI), all experts in RAM from 92 GB, a low-RAM mode below, vision, W4A8 prompts. Windows / CUDA 13.
GitHub · C++ · 255 stars · 31 forks · +2 stars in 24 hours · Trending score 1.47
-
2
ModelCloud/GPTQModel
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU, Tenstorrent, Huawei Ascent NPU, and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
GitHub · Python · 1,294 stars · 222 forks · +1 stars in 24 hours · Trending score 1.02
-
3
intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
GitHub · Python · 2,730 stars · 333 forks · 0 stars in 24 hours · Trending score 0.03
-
4
WestWaters/pollard-weights
A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from flash. Ships the residency calculator, measurement harnesses, and the build recipes behind it. Predictions validated against public benchmarks.
GitHub · Python · 34 stars · 7 forks · 0 stars in 24 hours · Trending score 0.00