YuhuaBillChen/justfit-llm
Run Qwen3.8-27B with its full 256K context on a 24 GB Mac. Long-context local LLM serving for Apple silicon, built on Inco AI's Splash. OpenAI-compatible API.
GitHub repository with 7 stars and 0 forks.
Language: C++
Topics: 27b, apple-silicon, fast-inference, inference, inference-engine, inference-optimization, llm, llm-agents, llm-inference, llms