mxfp4 repositories
Trending repositories tagged mxfp4, ranked by trending score. Updated daily.
-
1
FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
GitHub · C · 12,516 stars · 1,940 forks · +127 stars in 24 hours · Trending score 4.17
-
2
intel/auto-round
PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度
GitHub · Python · 1,706 stars · 205 forks · −2 stars in 24 hours · Trending score 0.64
-
3
ProprietaryLegal/Volta-Max-uPLIft-FP4-DeepSeek-V4.1-Flash-1017-NVFP4-8xV100-SXM2-PP2xTP4
Volta Max uPLIft: DeepSeek-V4.1-Flash-1017 on 8x V100-SXM2 (2018) with as much of the routed work at NVIDIA's NVFP4 precision as fits and every routed expert on the cards. One Hugging Face package, the code, every measurement. PLI Labs.
GitHub · Python · 21 stars · 0 forks · 0 stars in 24 hours · Trending score 0.55
-
4
tsaipifong/whirl-llm
WHIRL (Windows HIP Inference for RDNA LLMs): native Windows C++/HIP LLM inference engine for the AMD Ryzen AI Max+ 395 (Radeon 8060S) and Radeon AI PRO R9700. Unzip and run, only the AMD driver.
GitHub · C++ · 39 stars · 3 forks · 0 stars in 24 hours · Trending score 0.02
-
5
outerreaches/moonshine
Run the official Kimi K3 MoE checkpoint on one 128 GB AMD Strix Halo box. ROCm-resident static weights, MXFP4 experts streamed from NVMe via io_uring. C engine, chat client, OpenAI-compatible server. Very experimental.
GitHub · C · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
6
melonmath/microkimi
The Kimi K3 and DeepSeek-V4-Flash-0731 architectures, reimplemented from scratch in pure Rust (zero dependencies) and verified 1:1 against the official code.
GitHub · Rust · 23 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00
-
7
yeungtuzi/Xiaotu-LLM
XTU = X Transformers Unity — hybrid (CPU-expert + GPU) inference acceleration for vLLM: mainline plugin + CPU MoE engine (AVX512-VNNI/BF16 MXFP4/FP8), long-prefill GPU streaming, SM80 (A100) port.
GitHub · Python · 16 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00