LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
GitHub repository with 15,973 stars and 1,370 forks.
Language: Python
Topics: apple-silicon, inference-server, llm, macos, mlx, openai-api
2026-06-05: 15,973 stars and 1,370 forks.
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
GitHub repository with 2,804 stars and 160 forks.
Trending score: 1.88; stars gained: +95; forks gained: +7.
Language: Python
Topics: ai, apple-silicon, benchmarks, cli, command-line-tool, gguf
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
GitHub repository with 7,192 stars and 619 forks.
Trending score: 1.07; stars gained: +11; forks gained: +3.
Language: Python
Topics: apple-silicon, audio-processing, mlx, multimodal, speech-recognition, speech-synthesis
A library-science-inspired personal knowledge management system with LLM agents
GitHub repository with 41 stars and 7 forks.
Trending score: 0.61; stars gained: +3; forks gained: +1.
Language: Python
Topics: apple-silicon, arm64, desktop-app, docker, document-management, document-search
Extreme weight + KV cache compression for LLMs on Apple Silicon (MLX implementation of Google's TurboQuant)
GitHub repository with 41 stars and 10 forks.
Trending score: 0.48; stars gained: +2; forks gained: +0.
Language: Python
Topics: apple-silicon, kv-cache, llm, mlx, quantization, turboquant
🤖🗜️⚡️ Local LLM server for Apple Silicon. 5.4× faster end-to-end on long contexts vs Ollama, 33% less RAM, INT3 support for Qwen3. OpenAI + Ollama drop-in. Built for repeated long-context workloads on memory-constrained Macs.
GitHub repository with 7 stars and 0 forks.
Trending score: 0.07; stars gained: +0; forks gained: +0.
Language: Python
Topics: apple-silicon, llm, local-ai, local-llm, macos, mlx
Community-driven benchmark suite for MLX inference engines on Apple Silicon
GitHub repository with 7 stars and 2 forks.
Trending score: 0.04; stars gained: +0; forks gained: +0.
Language: Python
Topics: apple-silicon, benchmark, leaderboard, llm, mlx, omlx
The agent that grows with you
GitHub repository with 182,338 stars and 31,270 forks.
Trending score: 5.95; stars gained: +1,867; forks gained: +361.
Language: Python
Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.
GitHub repository with 14,053 stars and 885 forks.
Trending score: 5.69; stars gained: +2,829; forks gained: +175.
Language: Python
Topics: agent, ai, anthropic, compression, context-engineering, context-window
Academic Research Skills for Claude Code: research → write → review → revise → finalize
GitHub repository with 27,548 stars and 2,267 forks.
Trending score: 5.52; stars gained: +1,079; forks gained: +89.
Language: Python
Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review
Learn it. Build it. Ship it for others.
GitHub repository with 28,711 stars and 4,695 forks.
Trending score: 5.32; stars gained: +1,261; forks gained: +238.
Language: Python
Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course
An opinionated list of Python frameworks, libraries, tools, and resources
GitHub repository with 301,427 stars and 28,046 forks.
Trending score: 4.60; stars gained: +518; forks gained: +24.
Language: Python
Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools
The agent engineering platform.
GitHub repository with 138,587 stars and 22,961 forks.
Trending score: 4.53; stars gained: +171; forks gained: +31.
Language: Python
Topics: agents, ai, ai-agents, anthropic, chatgpt, deepagents
macOS menu bar app that tells you, in plain English, what each USB-C cable plugged into your Mac can actually do
GitHub repository with 5,457 stars and 169 forks.
Trending score: 4.04; stars gained: +203; forks gained: +3.
Language: Swift
Topics: apple-silicon, hardware-info, iokit, mac-app, macos, menubar
Native macOS app: drop a long video → auto-cut viral shorts, captioned for TikTok/Reels/YouTube, reframed to vertical, and scheduled. 100% on-device (Gemma 4 12B + WhisperKit + MLX).
GitHub repository with 95 stars and 17 forks.
Trending score: 1.90; stars gained: +63; forks gained: +13.
Language: Swift
Topics: apple-silicon, gemma, instagram-reels, macos, mlx, on-device-ai
Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.
GitHub repository with 2,804 stars and 160 forks.
Trending score: 1.88; stars gained: +95; forks gained: +7.
Language: Python
Topics: ai, apple-silicon, benchmarks, cli, command-line-tool, gguf
Camelid: a Rust-native local inference backend with evidence-gated model compatibility.
GitHub repository with 52 stars and 10 forks.
Trending score: 1.25; stars gained: +17; forks gained: +2.
Language: Rust
Topics: apple-silicon, gguf, inference, llama, llm, local-first
A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.
GitHub repository with 7,192 stars and 619 forks.
Trending score: 1.07; stars gained: +11; forks gained: +3.
Language: Python
Topics: apple-silicon, audio-processing, mlx, multimodal, speech-recognition, speech-synthesis
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.
GitHub repository with 135 stars and 8 forks.
Trending score: 1.00; stars gained: +8; forks gained: +2.
Language: Zig
Topics: agent, anthropic-api, apple-silicon, claude-code, inference, language-model