The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
GitHub repository with 2,800 stars and 342 forks.
Language: Python
Topics: apple-silicon, claude-code, cursor, deepseek, fastapi, hacktoberfest, inference, llm, local-llm, m1
2026-06-15: 2,800 stars and 342 forks.
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
GitHub repository with 4,787 stars and 263 forks.
Trending score: 4.13; stars gained: +62; forks gained: +5.
Language: Python
Topics: ai, cli, llm, local-llm, command-line-tool, gguf
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
GitHub repository with 16,627 stars and 1,411 forks.
Trending score: 3.94; stars gained: +104; forks gained: +2.
Language: Python
Topics: apple-silicon, inference-server, llm, macos, mlx, openai-api
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
GitHub repository with 5,057 stars and 592 forks.
Trending score: 2.57; stars gained: +14; forks gained: +2.
Language: Python
Topics: llava, llm, mlx, vision-transformer, apple-silicon, idefics
Self-hosted auto clustering AI agent OS for consumer hardware like the computer you already own, an Orange or Raspberry Pi or a Mac Mini etc. Full desktop, app store, agent deployment, distributed compute cluster. Memory by taOSmd.
GitHub repository with 236 stars and 21 forks.
Trending score: 1.84; stars gained: +7; forks gained: +0.
Language: Python
Topics: agent-framework, ai-agents, ai-platform, apple-silicon, distributed-computing, llm
A practical lab for exploring Apple's Core AI framework, model assets, specialization, and on-device inference.
GitHub repository with 16 stars and 0 forks.
Trending score: 0.91; stars gained: +1; forks gained: +0.
Language: Python
Topics: ai, apple, apple-core-ai, apple-silicon, core-ai, core-ai-framework
Extreme weight + KV cache compression for LLMs on Apple Silicon (MLX implementation of Google's TurboQuant)
GitHub repository with 46 stars and 10 forks.
Trending score: 0.75; stars gained: +1; forks gained: +0.
Language: Python
Topics: apple-silicon, kv-cache, llm, mlx, quantization, turboquant
利用AI大模型，一键生成高清短视频 Generate short videos with one click using AI LLM.
GitHub repository with 88,031 stars and 12,625 forks.
Trending score: 6.02; stars gained: +1,097; forks gained: +218.
Language: Python
Topics: ai, automation, chatgpt, moviepy, python, shortvideo
Self-hosted AI workspace.
GitHub repository with 71,420 stars and 9,105 forks.
Trending score: 5.98; stars gained: +834; forks gained: +140.
Language: Python
The agent that grows with you
GitHub repository with 194,087 stars and 33,984 forks.
Trending score: 5.92; stars gained: +753; forks gained: +209.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, and security risks.
GitHub repository with 5,654 stars and 427 forks.
Trending score: 5.61; stars gained: +874; forks gained: +76.
Language: Python
Learn it. Build it. Ship it for others.
GitHub repository with 32,676 stars and 5,366 forks.
Trending score: 5.59; stars gained: +762; forks gained: +135.
Language: Python
Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course
Generate draw.io diagrams from natural language — 6 presets, vision self-check + up to 5-round refinement, codebase-to-diagram, 10,000+ official shapes & 321 AI/LLM brand logos. Exports PNG/SVG/PDF/JPG.
GitHub repository with 3,445 stars and 240 forks.
Trending score: 5.51; stars gained: +1,369; forks gained: +113.
Language: Python
Topics: agent-skill, agent-skills, architecture-diagram, claude-code, claude-code-skill, claude-skills
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
GitHub repository with 4,787 stars and 263 forks.
Trending score: 4.13; stars gained: +62; forks gained: +5.
Language: Python
Topics: ai, cli, llm, local-llm, command-line-tool, gguf
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
GitHub repository with 16,627 stars and 1,411 forks.
Trending score: 3.94; stars gained: +104; forks gained: +2.
Language: Python
Topics: apple-silicon, inference-server, llm, macos, mlx, openai-api
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
GitHub repository with 5,779 stars and 216 forks.
Trending score: 2.70; stars gained: +16; forks gained: +0.
Language: Swift
Topics: apple-intelligence, apple-silicon, cli, foundationmodels, homebrew, llm
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
GitHub repository with 5,057 stars and 592 forks.
Trending score: 2.57; stars gained: +14; forks gained: +2.
Language: Python
Topics: llava, llm, mlx, vision-transformer, apple-silicon, idefics
AI speech toolkit for Apple Silicon — ASR, TTS, speech-to-speech, VAD, and diarization powered by MLX and CoreML
GitHub repository with 888 stars and 114 forks.
Trending score: 2.57; stars gained: +13; forks gained: +1.
Language: Swift
Topics: apple-silicon, asr, coreml, ios, macos, mlx
Fast, local voice app for Mac — system-wide dictation, file & YouTube transcription, and meeting recording. Powered by Parakeet TDT on Apple Silicon. Free and open-source.
GitHub repository with 377 stars and 37 forks.
Trending score: 2.10; stars gained: +6; forks gained: +0.
Language: Swift
Topics: apple-silicon, dictation, local-first, macos, meeting-recording, neural-engine