v100 repositories

Trending repositories tagged v100, ranked by trending score. Updated daily.

  1. 1
    poisonxa16/pxa

    The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; benchmarks vs llama.cpp in the README.

    GitHub · C++ · 126 stars · 16 forks · +8 stars in 24 hours · Trending score 1.53

  2. 2
    ww485000/ninfer-windows-v100

    Windows-only NInfer port for NVIDIA Tesla V100 32GB (sm_70), with Qwen3.8-27B NVFP4 at 228 tok/s.

    GitHub · C++ · 13 stars · 6 forks · +1 stars in 24 hours · Trending score 0.61

  3. 3
    Leonccaa/ReVolta

    Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/disk KV offload, and MTP or DFlash2 speculative decoding.

    GitHub · Python · 68 stars · 2 forks · 0 stars in 24 hours · Trending score 0.59

  4. 4
    aaalll12322/ComfyUI-MiniMaxH3-SolAttn-V100

    Sol-Attn (arXiv 2607.24027) sparse acceleration for MiniMax H3 on V100 — single-node ComfyUI plugin (embedded FP16Safe + keep-or-drop kernel)

    GitHub · C++ · 35 stars · 3 forks · 0 stars in 24 hours · Trending score 0.58

  5. 5
    ProprietaryLegal/Volta-Max-uPLIft-FP4-DeepSeek-V4.1-Flash-1017-NVFP4-8xV100-SXM2-PP2xTP4

    Volta Max uPLIft: DeepSeek-V4.1-Flash-1017 on 8x V100-SXM2 (2018) with as much of the routed work at NVIDIA's NVFP4 precision as fits and every routed expert on the cards. One Hugging Face package, the code, every measurement. PLI Labs.

    GitHub · Python · 21 stars · 0 forks · 0 stars in 24 hours · Trending score 0.51

  6. 6
    Havensky-stack/windows-ninfer-V100X2

    面向 Windows 11 双 Tesla V100 的本地 Qwen 推理项目:原生 C++/CUDA、中文便携启动器、TP2 通信优化、实验 MTP/DFlash、OpenAI/Anthropic 兼容 API 与 TCC/WDDM 切换。基于 NInfer 上游独立维护。

    GitHub · C++ · 13 stars · 4 forks · 0 stars in 24 hours · Trending score 0.14

  7. 7
    ProprietaryLegal/Volta-sPLIt-DeepSeek-V4.1-Flash-1017-8xV100-SXM2-PP2xTP4

    DeepSeek-V4.1-Flash-1017 on 8x V100-SXM2 (2018): 119.0 tok/s decode, 120.8 thinking on (measured), 524K context, 300K-token first token in 178 s. PP2xTP4 port of 1Cat-vLLM #1277 with every patch, measurement and lost lever. PLI Labs.

    GitHub · Python · 36 stars · 4 forks · 0 stars in 24 hours · Trending score 0.03

  8. 8
    fishlikeX/sm70-attn

    FlashAttention brought back to Tesla V100 — a deep llama.cpp fork: SM 7.0 D256 kernels, SplitKV3, q4_0 KV cache, DFlash2 speculative decoding and multimodal fixes.

    GitHub · C++ · 21 stars · 5 forks · 0 stars in 24 hours · Trending score 0.01

  9. 9
    Redhatvale/Nvidia-Tesla-v100-nvfp4-pcie

    Qwen3.8-27B in native NVFP4/FP8 on 2x PCIe Tesla V100-32GB (SM70): the PCIe runbook for v100-skinny + 1Cat-vLLM, with the 3 fixes that make it work without NVLink. 61-74 tok/s decode, MTP speculative decoding, OpenAI-compatible.

    GitHub · Shell · 17 stars · 4 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    1115714829/llama.cpp-v100

    llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefill 3402 tok/s at 200K; 2 GPUs on one socket: 2152 tok/s). Qwen3.8-27B with DFlash2 on 1-6 GPUs, up to 512K context. Multimodal, thinking, concurrent serving, built-in web UI.

    GitHub · C++ · 84 stars · 17 forks · 0 stars in 24 hours · Trending score 0.00

  11. 11
    zipenghao/strata-v100-sm70

    Unofficial third-party patches: run Strata (Qwen3.8-Flash-Next) on 2x Tesla V100 sm_70 - platform patches, a PLE correctness fix that garbles output if unpatched, dual-GPU tuning to 43 tok/s @128K

    GitHub · Shell · 11 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00