ssd-streaming repositories
Trending repositories tagged ssd-streaming, ranked by trending score. Updated daily.
-
1
yanun0323/Whallm
DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook
GitHub · Python · 151 stars · 18 forks · +26 stars in 24 hours · Trending score 2.35
-
2
1picassoai/kraits
Run stock llama.cpp with large MoE models like Qwen3.8-Flash-Next (91 GB, 4-bit) on a 16 GB Mac.
GitHub · Rust · 20 stars · 1 forks · +5 stars in 24 hours · Trending score 1.32
-
3
Ninnix/q36
Qwen3.8-27B and Qwen3.6-35B-A3B local inference engine for Vulkan and Metal
GitHub · C · 87 stars · 10 forks · +4 stars in 24 hours · Trending score 1.23
-
4
outerreaches/moonshine
Run the official Kimi K3 MoE checkpoint on one 128 GB AMD Strix Halo box. ROCm-resident static weights, MXFP4 experts streamed from NVMe via io_uring. C engine, chat client, OpenAI-compatible server. Very experimental.
GitHub · C · 9 stars · 0 forks · +2 stars in 24 hours · Trending score 0.73
-
5
srcterm/streamlx
Fast and lightweight SSD-streaming engine for MoE models on Apple Silicon with MLX
GitHub · Python · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.19