fp4 repositories

Trending repositories tagged fp4, ranked by trending score. Updated daily.

  1. 1
    Tencent/AngelSlim

    Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

    GitHub · Python · 1,809 stars · 200 forks · +15 stars in 24 hours · Trending score 2.27

  2. 2
    xl03-bit/sm120-nvfp4-training

    Faster, more memory-efficient NVFP4 training

    GitHub · Python · 113 stars · 13 forks · +4 stars in 24 hours · Trending score 1.50

  3. 3
    NVIDIA/TransformerEngine

    A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

    GitHub · Python · 3,609 stars · 901 forks · +2 stars in 24 hours · Trending score 1.27

  4. 4
    FP4-is-All-you-Need/BLAS

    Exact matrix products on FP4 Tensor Cores: the Adaptive Weight Encoding (AWE) catalog and the BLAS routines built on it.

    GitHub · Cuda · 7 stars · 0 forks · +1 stars in 24 hours · Trending score 0.56

  5. 5
    hanxiao/DeepSeek-V4.1-Flash-1017-FP8-abliterated-4x-RTX-PRO-6000

    Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21, DSpark + FLy verification and top_p 1.0: 463 tok/s single-stream agent decode at 30k-120k context, 1082 tok/s over 8 streams, 1M context, Flex-start GCE VM

    GitHub · Python · 57 stars · 10 forks · 0 stars in 24 hours · Trending score 0.04

  6. 6
    intel/neural-compressor

    SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, and ONNX Runtime

    GitHub · Python · 2,730 stars · 333 forks · 0 stars in 24 hours · Trending score 0.03

  7. 7
    vipshop/ffpa-attn

    Kernel Library for Large Headdim Attention (64~1024, BF16/FP8/FP4), 1.5x~15x↑ vs PyTorch SDPA.

    GitHub · Python · 341 stars · 29 forks · 0 stars in 24 hours · Trending score 0.00

  8. 8
    julianmb/q38rocm

    Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.

    GitHub · Python · 269 stars · 12 forks · 0 stars in 24 hours · Trending score 0.00

  9. 9
    julianmb/halofpx

    High-performance Lemonade alternative for AMD Strix Halo & Radeon — latest MoE models (Ling-3.0-Flash, Qwen 3.8 Flash Next, Ornith 1.5), bleeding-edge RDNA 3.5 Wave64/ROCmFP4 kernels, and silicon-tuned profiles.

    GitHub · Python · 94 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    devopsfortunato/Qwen3.8-Flash-Next-FP4-Local-DGX-Spark

    One-command recipe to serve nvidia/Qwen3.8-Flash-Next-FP4-Local on a single NVIDIA DGX Spark with vLLM (OpenAI-compatible API).

    GitHub · Shell · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00