ninfer repositories
Trending repositories tagged ninfer, ranked by trending score. Updated daily.
-
1
CSUNX233/Sparkle-Qwen27b-Kvmem-ninfer
RTX 5070 Ti Laptop 12GB 跑 Qwen3.8-27B:NInfer + KVMem、256K 逻辑上下文、RAM KV、MTP、快速缓存续接与 dsh 本地 Agent / 搜索 / 浏览器。含源码、Windows 部署及实测。
GitHub · C++ · 101 stars · 5 forks · 0 stars in 24 hours · Trending score 0.48
-
2
Havensky-stack/windows-ninfer-V100X2
面向 Windows 11 双 Tesla V100 的本地 Qwen 推理项目:原生 C++/CUDA、中文便携启动器、TP2 通信优化、实验 MTP/DFlash、OpenAI/Anthropic 兼容 API 与 TCC/WDDM 切换。基于 NInfer 上游独立维护。
GitHub · C++ · 13 stars · 4 forks · +1 stars in 24 hours · Trending score 0.46
-
3
T-Crypt/speculum
monitor for a local LLM runtime (llama-swap, NInfer, Strata, more) -- metrics ported to berth.
GitHub · Python · 15 stars · 0 forks · 0 stars in 24 hours · Trending score 0.22
-
4
ahnafnafee/ninfer-3080
NInfer for a 10 GB RTX 3080 on native Windows: MSVC and CUDA 13 build fixes, a built-in RTX 3080 device profile, and ninfer-switch. Based on iamwavecut/ninfer-3090.
GitHub · C++ · 7 stars · 1 forks · 0 stars in 24 hours · Trending score 0.00