manjunathshiva/turboquant-mlx

Extreme weight + KV cache compression for LLMs on Apple Silicon (MLX implementation of Google's TurboQuant)

GitHub repository with 41 stars and 10 forks.

Language: Python

Topics: apple-silicon, kv-cache, llm, mlx, quantization, turboquant

Open provider repository

24h trend summary

Trending score 0.48, activity score 0.03, stars gained +2, forks gained +0.

Latest metric snapshot

2026-06-02: 41 stars and 10 forks.

Similar repositories

  1. 1. Andyyyy64/whichllm

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

    GitHub repository with 2,804 stars and 160 forks.

    Trending score: 1.88; stars gained: +95; forks gained: +7.

    Language: Python

    Topics: ai, apple-silicon, benchmarks, cli, command-line-tool, gguf

  2. 2. Blaizzy/mlx-audio

    A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

    GitHub repository with 7,192 stars and 619 forks.

    Trending score: 1.07; stars gained: +11; forks gained: +3.

    Language: Python

    Topics: apple-silicon, audio-processing, mlx, multimodal, speech-recognition, speech-synthesis

  3. 3. shenmintao/marginalia

    A library-science-inspired personal knowledge management system with LLM agents

    GitHub repository with 41 stars and 7 forks.

    Trending score: 0.61; stars gained: +3; forks gained: +1.

    Language: Python

    Topics: apple-silicon, arm64, desktop-app, docker, document-management, document-search

  4. 4. manjunathshiva/turboquant-mlx

    Extreme weight + KV cache compression for LLMs on Apple Silicon (MLX implementation of Google's TurboQuant)

    GitHub repository with 41 stars and 10 forks.

    Trending score: 0.48; stars gained: +2; forks gained: +0.

    Language: Python

    Topics: apple-silicon, kv-cache, llm, mlx, quantization, turboquant

  5. 5. konjoai/squish

    🤖🗜️⚡️ Local LLM server for Apple Silicon. 5.4× faster end-to-end on long contexts vs Ollama, 33% less RAM, INT3 support for Qwen3. OpenAI + Ollama drop-in. Built for repeated long-context workloads on memory-constrained Macs.

    GitHub repository with 7 stars and 0 forks.

    Trending score: 0.07; stars gained: +0; forks gained: +0.

    Language: Python

    Topics: apple-silicon, llm, local-ai, local-llm, macos, mlx

  6. 6. igurss/mlx-chronos

    Community-driven benchmark suite for MLX inference engines on Apple Silicon

    GitHub repository with 7 stars and 2 forks.

    Trending score: 0.04; stars gained: +0; forks gained: +0.

    Language: Python

    Topics: apple-silicon, benchmark, leaderboard, llm, mlx, omlx

Trending in Python

  1. 1. NousResearch/hermes-agent

    The agent that grows with you

    GitHub repository with 182,353 stars and 31,271 forks.

    Trending score: 5.95; stars gained: +1,867; forks gained: +361.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude

  2. 2. chopratejas/headroom

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

    GitHub repository with 14,053 stars and 885 forks.

    Trending score: 5.69; stars gained: +2,829; forks gained: +175.

    Language: Python

    Topics: agent, ai, anthropic, compression, context-engineering, context-window

  3. 3. Imbad0202/academic-research-skills

    Academic Research Skills for Claude Code: research → write → review → revise → finalize

    GitHub repository with 27,548 stars and 2,267 forks.

    Trending score: 5.52; stars gained: +1,079; forks gained: +89.

    Language: Python

    Topics: academic-pipeline, academic-writing, ai-research, claude, claude-code, literature-review

  4. 4. rohitg00/ai-engineering-from-scratch

    Learn it. Build it. Ship it for others.

    GitHub repository with 28,711 stars and 4,695 forks.

    Trending score: 5.32; stars gained: +1,261; forks gained: +238.

    Language: Python

    Topics: agents, ai, ai-agents, ai-engineering, computer-vision, course

  5. 5. vinta/awesome-python

    An opinionated list of Python frameworks, libraries, tools, and resources

    GitHub repository with 301,427 stars and 28,046 forks.

    Trending score: 4.60; stars gained: +518; forks gained: +24.

    Language: Python

    Topics: awesome, python, collections, python-frameworks, python-libraries, python-tools

  6. 6. langchain-ai/langchain

    The agent engineering platform.

    GitHub repository with 138,587 stars and 22,961 forks.

    Trending score: 4.53; stars gained: +171; forks gained: +31.

    Language: Python

    Topics: agents, ai, ai-agents, anthropic, chatgpt, deepagents

Trending topic: apple-silicon

  1. 1. darrylmorley/whatcable

    macOS menu bar app that tells you, in plain English, what each USB-C cable plugged into your Mac can actually do

    GitHub repository with 5,457 stars and 169 forks.

    Trending score: 4.04; stars gained: +203; forks gained: +3.

    Language: Swift

    Topics: apple-silicon, hardware-info, iokit, mac-app, macos, menubar

  2. 2. mutonby/shortcast

    Native macOS app: drop a long video → auto-cut viral shorts, captioned for TikTok/Reels/YouTube, reframed to vertical, and scheduled. 100% on-device (Gemma 4 12B + WhisperKit + MLX).

    GitHub repository with 99 stars and 17 forks.

    Trending score: 1.90; stars gained: +63; forks gained: +13.

    Language: Swift

    Topics: apple-silicon, gemma, instagram-reels, macos, mlx, on-device-ai

  3. 3. Andyyyy64/whichllm

    Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

    GitHub repository with 2,804 stars and 160 forks.

    Trending score: 1.88; stars gained: +95; forks gained: +7.

    Language: Python

    Topics: ai, apple-silicon, benchmarks, cli, command-line-tool, gguf

  4. 4. timtoole02/Camelid

    Camelid: a Rust-native local inference backend with evidence-gated model compatibility.

    GitHub repository with 52 stars and 10 forks.

    Trending score: 1.25; stars gained: +17; forks gained: +2.

    Language: Rust

    Topics: apple-silicon, gguf, inference, llama, llm, local-first

  5. 5. Blaizzy/mlx-audio

    A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

    GitHub repository with 7,192 stars and 619 forks.

    Trending score: 1.07; stars gained: +11; forks gained: +3.

    Language: Python

    Topics: apple-silicon, audio-processing, mlx, multimodal, speech-recognition, speech-synthesis

  6. 6. ddalcu/mlx-serve

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agent mode, and tool calling.

    GitHub repository with 135 stars and 8 forks.

    Trending score: 1.00; stars gained: +8; forks gained: +2.

    Language: Zig

    Topics: agent, anthropic-api, apple-silicon, claude-code, inference, language-model