rtx-pro-6000 repositories
Trending repositories tagged rtx-pro-6000, ranked by trending score. Updated daily.
-
1
autonomous-ai/Personal-AI-Computer
Open-source AI computer builds, from 2-GPU desktops to 8-GPU servers: CAD, BOM, BIOS and build guides. Get the case kit with PCIe risers, or ask us for a free fit check.
GitHub · 1,600 stars · 178 forks · +348 stars in 24 hours · Trending score 4.26
-
2
kacper-daftcode/vLLM-Moet
Frontier MoE models on RTX PRO 6000 / RTX 5090 (sm_120): DeepSeek-V4.1-Flash on 4x RTX PRO 6000, as a GPU+CPU hybrid on 4x RTX 5090, and 2-bit experts on vLLM v0.24.0
GitHub · Sass · 579 stars · 49 forks · +7 stars in 24 hours · Trending score 1.44
-
3
avifenesh/memra
Memra is a Rust + CUDA LLM inference engine with hand-written kernels, NVFP4 and mixed-precision execution, and correctness gates scoped to each model and GPU
GitHub · Rust · 7 stars · 1 forks · +1 stars in 24 hours · Trending score 0.63
-
4
kekzl/imp
Run large AI chat models privately on your own NVIDIA RTX 50 or RTX PRO graphics card. On one RTX 5090, Qwen3.8-27B writes about 70 words per second, 1.4x faster than vLLM. Even a model almost four times larger than the card's memory runs. Works with apps made for ChatGPT or Claude. Starts with one docker command.
GitHub · C++ · 79 stars · 6 forks · −4 stars in 24 hours · Trending score 0.10
-
5
theogravity/deepseek-flash-v4.1-dual-rtx-6000
Setup for running DS4.1 flash with reasonable quality and speed on 2x RTX 6000 PRO @ 512k context c6 max w/ RAM and disk offload / caching
GitHub · Python · 7 stars · 0 forks · 0 stars in 24 hours · Trending score 0.07
-
6
hanxiao/DeepSeek-V4.1-Flash-1017-FP8-abliterated-4x-RTX-PRO-6000
Abliterated DeepSeek-V4.1-Flash-1017 (FP8 dense, FP4 experts) on 4x RTX PRO 6000 with vLLM-Moet r21, DSpark + FLy verification and top_p 1.0: 463 tok/s single-stream agent decode at 30k-120k context, 1082 tok/s over 8 streams, 1M context, Flex-start GCE VM
GitHub · Python · 57 stars · 10 forks · 0 stars in 24 hours · Trending score 0.04
-
7
jpezzulli/sglang-rtxpro6000
Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell 96 GB GPU (SM120): 524K context, HiCache and NIXL.
GitHub · Python · 179 stars · 26 forks · 0 stars in 24 hours · Trending score 0.00
-
8
SSHdotCodes/qwen-3.8-flash-next-pro6000
SGLang 0.5.21 for Qwen3.8-Flash-Next on one RTX PRO 6000: 264.5 tok/s decode, W4A16 routed experts (KLD 0.0111 vs BF16), 262K context, exact speculative rejection sampling, reproducible benchmarks.
GitHub · Python · 17 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00
-
9
samuelcardillo/glm-5.3-flash-2x-rtx-pro-6000-blackwell
Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.
GitHub · Python · 58 stars · 6 forks · 0 stars in 24 hours · Trending score 0.00
-
10
Aevonix/GLM-5.3-Flash-EXL3-4x-RTX-PRO-6000-TensorFold
GLM-5.3-Flash EXL3 on 4x RTX PRO 6000 with TensorFold: one-command recipe and engine patches. By Aevonix Research in collaboration with Mia's AI Lab.
GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.00