skydiscover-ai/jitengine
LLM serving engines that SkyDiscover builds on the fly for specific AI models and hardware: Qwen3.6-35B-A3B, Qwen3.8-Flash-Next and Flint on Apple silicon Macs
GitHub repository with 44 stars and 1 forks.
Language: Python
Topics: apple-silicon, coding-agents, llm, llm-inference, llm-serving, macos, metal, mixture-of-experts, mlx, openai-api