san-digital/tokspur
Private chat and code on your Mac. Run a 177B model on a 128 GB M5 Max: local Qwen3.8 Flash-Next inference with a 65,536-token context, Tokspur's own Metal engine with native MTP, and an OpenAI-compatible API. Apache 2.0.
GitHub repository with 24 stars and 2 forks.
Language: C++
Topics: apple-silicon, gguf, inference-engine, llm, llm-inference, local-inference, local-llm, m5-max, macos, metal