fp4 repositories
Trending repositories tagged fp4, ranked by trending score. Updated daily.
-
1
Tencent/AngelSlim
Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
GitHub · Python · 1,809 stars · 200 forks · +15 stars in 24 hours · Trending score 2.27
-
2
xl03-bit/sm120-nvfp4-training
Faster, more memory-efficient NVFP4 training
GitHub · Python · 113 stars · 13 forks · +4 stars in 24 hours · Trending score 1.50
-
3
NVIDIA/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
GitHub · Python · 3,609 stars · 901 forks · +2 stars in 24 hours · Trending score 1.27
-
4
FP4-is-All-you-Need/BLAS
Exact matrix products on FP4 Tensor Cores: the Adaptive Weight Encoding (AWE) catalog and the BLAS routines built on it.
GitHub · Cuda · 7 stars · 0 forks · +1 stars in 24 hours · Trending score 0.56
-
5
hanxiao/DeepSeek-V4.1-Flash-1017-FP8-abliterated-4x-RTX-PRO-6000
Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21, DSpark + FLy verification and top_p 1.0: 463 tok/s single-stream agent decode at 30k-120k context, 1082 tok/s over 8 streams, 1M context, Flex-start GCE VM
GitHub · Python · 57 stars · 10 forks · 0 stars in 24 hours · Trending score 0.04
-
6
intel/neural-compressor
SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime
GitHub · Python · 2,730 stars · 333 forks · 0 stars in 24 hours · Trending score 0.03
-
7
vipshop/ffpa-attn
Kernel Library for Large Headdim Attention (64~1024, BF16/FP8/FP4), 1.5x~15x↑ vs PyTorch SDPA.
GitHub · Python · 341 stars · 29 forks · 0 stars in 24 hours · Trending score 0.00
-
8
julianmb/q38rocm
Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.
GitHub · Python · 269 stars · 12 forks · 0 stars in 24 hours · Trending score 0.00
-
9
julianmb/halofpx
High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.
GitHub · Python · 94 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00
-
10
devopsfortunato/Qwen3.8-Flash-Next-FP4-Local-DGX-Spark
One-command recipe to serve nvidia/Qwen3.8-Flash-Next-FP4-Local on a single NVIDIA DGX Spark with vLLM (OpenAI-compatible API).
GitHub · Shell · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00