Incept5-AI/inferd
Native Apple Silicon inference engine for many AI agents at once: C++/Metal, agent-contexts API, 8-bit paged KV, SSD tier (Qwen3.8)
GitHub repository with 35 stars and 3 forks.
Language: Python
Topics: agents, apple-silicon, llm-inference, metal, mlx, qwen