05yuki/deepseek-v4.1-flash-1017-ktransformers
Run DeepSeek-V4.1-Flash-1017 with SGLang + KTransformers (CPU/GPU hybrid): one setup script, a launcher that reads the machine, and the FP8 step 1017 needs
GitHub repository with 5 stars and 4 forks.
Language: Python
Topics: cpu-gpu-hybrid, deepseek, deepseek-v4, fp8, ktransformers, local-llm, moe, sglang