blackwell repositories

Trending repositories tagged blackwell, ranked by trending score. Updated daily.

  1. 1
    vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    GitHub · Python · 97,255 stars · 25,073 forks · +109 stars in 24 hours · Trending score 4.26

  2. 2
    NVIDIA/TensorRT-LLM

    TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

    GitHub · Python · 15,105 stars · 2,944 forks · +21 stars in 24 hours · Trending score 2.65

  3. 3
    sergqwer/strata-nvfp4

    Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU experts on AVX-512 or AVX2 (+AVX-VNNI), all experts in RAM from 92 GB, a low-RAM mode below, vision, W4A8 prompts. Windows / CUDA 13.

    GitHub · C++ · 251 stars · 31 forks · +23 stars in 24 hours · Trending score 2.42

  4. 4
    lightseekorg/tokenspeed

    TokenSpeed is a speed-of-light LLM inference engine.

    GitHub · Python · 2,944 stars · 422 forks · +10 stars in 24 hours · Trending score 2.18

  5. 5
    sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    GitHub · Python · 38,872 stars · 10,647 forks · −123 stars in 24 hours · Trending score 1.80

  6. 6
    xl03-bit/sm120-nvfp4-training

    Faster, more memory-efficient NVFP4 training

    GitHub · Python · 111 stars · 13 forks · +6 stars in 24 hours · Trending score 1.62

  7. 7
    NVIDIA/cudnn-frontend

    cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

    GitHub · Cuda · 1,007 stars · 340 forks · +3 stars in 24 hours · Trending score 1.47

  8. 8
    kacper-daftcode/vLLM-Moet

    Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0

    GitHub · Sass · 579 stars · 49 forks · +7 stars in 24 hours · Trending score 1.44

  9. 9
    gpillon/ignis

    An inference engine for one NVIDIA RTX card, built for a coding agent and its subagents, and a companion that listens, reads and draws: Qwen3.8 27B and 125B Flash-Next MoE, Qwen-Image-2.1, Qwen3-ASR on the CPU. OpenAI-compatible API and Playground in one binary.

    GitHub · Rust · 67 stars · 9 forks · +1 stars in 24 hours · Trending score 0.72

  10. 10
    avifenesh/memra

    Memra is a Rust + CUDA LLM inference engine with hand-written kernels, NVFP4 and mixed-precision execution, and correctness gates scoped to each model and GPU

    GitHub · Rust · 7 stars · 1 forks · +1 stars in 24 hours · Trending score 0.63

  11. 11
    hzX40000000/SFU-Sim

    Bit-exact NVIDIA MUFU/SFU model, exhaustively verified on A100, Ada and Blackwell GPUs.

    GitHub · C++ · 10 stars · 1 forks · 0 stars in 24 hours · Trending score 0.50

  12. 12
    MerkyorLynn/lynn-engine

    Lynn 原生 LLM 推理引擎 · W4A8/NVFP4 量化 · 自写 CUDA/Triton kernel · MoE · 投机解码 | Lynn-native LLM inference engine for NVIDIA Blackwell

    GitHub · Python · 28 stars · 0 forks · 0 stars in 24 hours · Trending score 0.48

  13. 13
    DamianKA1993/blackwell-egpu-manager

    Dynamic PCIe Gen4/Gen5 retrainer, clock stabilization & state manager for NVIDIA Blackwell (RTX 50xx) eGPUs on Linux (KDE Plasma 6).

    GitHub · Shell · 11 stars · 1 forks · 0 stars in 24 hours · Trending score 0.32

  14. 14
    timothystewart6/ubuntu-gb10

    Ubuntu 24.04 + NVIDIA stack setup guide for GB10 / DGX Spark systems

    GitHub · Jinja · 26 stars · 5 forks · 0 stars in 24 hours · Trending score 0.14

  15. 15
    kekzl/imp

    Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.

    GitHub · C++ · 79 stars · 6 forks · −4 stars in 24 hours · Trending score 0.10

  16. 16
    truespar/paddock

    Native Rust inference server for open models on NVIDIA and Apple Silicon. OpenAI- and Anthropic-compatible APIs, GGUF + safetensors + MLX, FP8/NVFP4/MXFP4/Q8/Q4, built-in Studio

    GitHub · Rust · 164 stars · 25 forks · 0 stars in 24 hours · Trending score 0.08

  17. 17
    AEON-7/comfyui-aeon-spark

    Bleeding-edge ComfyUI for NVIDIA DGX Spark (GB10/Blackwell/sm_121a). CUDA 13 + SageAttention v3 (sm_121a) + NVFP4 + 14 custom-node packs + Flux 2 Dev / LTX 2.3 22B / ACE-Step v1.5 XL Turbo pre-bundled with abliterated text-encoder paths.

    GitHub · Shell · 90 stars · 18 forks · 0 stars in 24 hours · Trending score 0.05

  18. 18
    hanxiao/DeepSeek-V4.1-Flash-1017-FP8-abliterated-4x-RTX-PRO-6000

    Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21, DSpark + FLy verification and top_p 1.0: 463 tok/s single-stream agent decode at 30k-120k context, 1082 tok/s over 8 streams, 1M context, Flex-start GCE VM

    GitHub · Python · 57 stars · 10 forks · 0 stars in 24 hours · Trending score 0.04

  19. 19
    GoBrrr-ai/mjolnir

    Mjölnir — faster, bigger-context LLM serving on edge GPUs: a dedicated decode kernel per platform, a tuned vLLM image that carries every kernel, and a CLI that serves, benchmarks and documents it.

    GitHub · Python · 12 stars · 4 forks · 0 stars in 24 hours · Trending score 0.04

  20. 20
    openlake-project/openlake

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    GitHub · Rust · 3,094 stars · 421 forks · 0 stars in 24 hours · Trending score 0.04

  21. 21
    actypedef/ARCQuant

    [ACL 2026 Main] Code for the paper "ARCQuant: Boosting NVFP4 Quantization with Augmented Residual Channels for LLMs"

    GitHub · Cuda · 35 stars · 9 forks · 0 stars in 24 hours · Trending score 0.04

  22. 22
    xilla420/dlss5-wow-sidecar

    DLSS 5 Neural Rendering for World of Warcraft (WoW) on NVIDIA RTX 40/50 — a safe overlay with no DLL injection, no hooks and no ReShade next to Wow.exe. Free and open source.

    GitHub · C++ · 38 stars · 11 forks · 0 stars in 24 hours · Trending score 0.04

  23. 23
    amasu/dgx-spark-qwen38

    Docker compose configs for serving Qwen3.8-27B on a DGX Spark (GB10): vLLM+MTP current, SGLang+DSPARK + FP8 rollback stacks

    GitHub · Shell · 13 stars · 0 forks · 0 stars in 24 hours · Trending score 0.03

  24. 24
    bidual/awesome-dgx-spark

    A curated list of tools, guides, playbooks, and resources for the NVIDIA DGX Spark (GB10 Grace Blackwell personal AI supercomputer).

    GitHub · Shell · 97 stars · 8 forks · 0 stars in 24 hours · Trending score 0.00