rtx-pro-6000 repositories

Trending repositories tagged rtx-pro-6000, ranked by trending score. Updated daily.

  1. 1
    autonomous-ai/Personal-AI-Computer

    Open-source AI computer builds, from 2-GPU desktops to 8-GPU servers: CAD, BOM, BIOS and build guides. Get the case kit with PCIe risers, or ask us for a free fit check.

    GitHub · 1,600 stars · 178 forks · +348 stars in 24 hours · Trending score 4.26

  2. 2
    kacper-daftcode/vLLM-Moet

    Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0

    GitHub · Sass · 579 stars · 49 forks · +7 stars in 24 hours · Trending score 1.44

  3. 3
    avifenesh/memra

    Memra is a Rust + CUDA LLM inference engine with hand-written kernels, NVFP4 and mixed-precision execution, and correctness gates scoped to each model and GPU

    GitHub · Rust · 7 stars · 1 forks · +1 stars in 24 hours · Trending score 0.63

  4. 4
    kekzl/imp

    Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.

    GitHub · C++ · 79 stars · 6 forks · −4 stars in 24 hours · Trending score 0.10

  5. 5
    theogravity/deepseek-flash-v4.1-dual-rtx-6000

    Setup for running DS4.1 flash with reasonable quality and speed on 2x RTX 6000 PRO @ 512k context c6 max w/ RAM and disk offload / caching

    GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07

  6. 6
    hanxiao/DeepSeek-V4.1-Flash-1017-FP8-abliterated-4x-RTX-PRO-6000

    Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21, DSpark + FLy verification and top_p 1.0: 463 tok/s single-stream agent decode at 30k-120k context, 1082 tok/s over 8 streams, 1M context, Flex-start GCE VM

    GitHub · Python · 57 stars · 10 forks · 0 stars in 24 hours · Trending score 0.04

  7. 7
    jpezzulli/sglang-rtxpro6000

    Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU (SM120): 524K context, HiCache and NIXL.

    GitHub · Python · 179 stars · 26 forks · 0 stars in 24 hours · Trending score 0.00

  8. 8
    SSHdotCodes/qwen-3.8-flash-next-pro6000

    SGLang 0.5.21 for Qwen3.8-Flash-Next on one RTX PRO 6000: 264.5 tok/s decode, W4A16 routed experts (KLD 0.0111 vs BF16), 262K context, exact speculative rejection sampling, reproducible benchmarks.

    GitHub · Python · 17 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00

  9. 9
    samuelcardillo/glm-5.3-flash-2x-rtx-pro-6000-blackwell

    Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.

    GitHub · Python · 58 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00

  10. 10
    Aevonix/GLM-5.3-Flash-EXL3-4x-RTX-PRO-6000-TensorFold

    GLM-5.3-Flash EXL3 on 4x RTX PRO 6000 with TensorFold: one-command recipe and engine patches. By Aevonix Research in collaboration with Mia's AI Lab.

    GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00