lightseekorg/smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

GitHub repository with 316 stars and 88 forks.

Language: Rust

Topics: anthropic, claude, gemini, inference-gateway, llm, openai, routing, sglang, vllm, tensorrtllm

Open provider repository

Latest metric snapshot

2026-06-05: 316 stars and 88 forks.

Similar repositories

  1. 1. thClaws/thClaws

    Open-source AI agent harness in native Rust — GUI, CLI, headless, and webapp from one binary. Multi-provider, MCP, skills, plugins, agent teams.

    GitHub repository with 1,077 stars and 152 forks.

    Trending score: 1.97; stars gained: +11; forks gained: +2.

    Language: Rust

    Topics: agent-harness, agent-teams, ai-agent, anthropic, claude-code, cli

  2. 2. tensorzero/tensorzero

    TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

    GitHub repository with 11,437 stars and 835 forks.

    Trending score: 1.14; stars gained: +10; forks gained: +1.

    Language: Rust

    Topics: ai, artificial-intelligence, deep-learning, gpt, llm, llmops

  3. 3. shiwenwen/hope-agent

    🦭跨端交接、越用越懂你的桌面 AI 助手——也能服务化常驻、跑在云上 | Desktop AI that hands off across your devices and gets to know you better — also runs headless on a NAS or in the cloud

    GitHub repository with 914 stars and 78 forks.

    Trending score: 1.10; stars gained: +13; forks gained: +1.

    Language: Rust

    Topics: agent, ai, ai-assistant, anthropic, chatbot, claude

  4. 4. wshm-dev/wshm

    AI-powered repository agent for GitHub, GitLab, Gitea, Azure DevOps. Issue triage, PR analysis, merge queue, notifications, dashboard, backup. Self-hosted, multi-provider.

    GitHub repository with 59 stars and 5 forks.

    Trending score: 0.73; stars gained: +1; forks gained: +1.

    Language: Rust

    Topics: ai, anthropic, automation, cli, devops, github

  5. 5. AssafWoo/homebrew-pandafilter

    The context intelligence layer for AI coding agents. Compressing noise, routing content to the right strategy, preserving session state across compactions, and surfacing the files that actually matter.

    GitHub repository with 99 stars and 10 forks.

    Trending score: 0.56; stars gained: +1; forks gained: +0.

    Language: Rust

    Topics: agentic-coding, ai-coding, anthropic, bert, builders, claude-code

  6. 6. MikkoParkkola/mcp-gateway

    Universal MCP Gateway - Single-port multiplexing with Meta-MCP for ~95% context token savings

    GitHub repository with 34 stars and 9 forks.

    Trending score: 0.49; stars gained: +2; forks gained: +0.

    Language: Rust

    Topics: ai, anthropic, claude, gateway, llm, mcp

Trending in Rust

  1. 1. BigPizzaV3/CodexPlusPlus

    An enhanced tool for CodexApp, striving to make Codex better to use and more comfortable 一个CodexApp的增强工具,努力让Codex变得更好用更舒服

    GitHub repository with 13,828 stars and 857 forks.

    Trending score: 5.16; stars gained: +916; forks gained: +44.

    Language: Rust

  2. 2. Hmbown/CodeWhale

    DeepSeek + MiMo coding agent in terminal

    GitHub repository with 37,132 stars and 3,195 forks.

    Trending score: 4.80; stars gained: +393; forks gained: +32.

    Language: Rust

    Topics: cli, deepseek, llm, rust, terminal, tui

  3. 3. openai/codex

    Lightweight coding agent that runs in your terminal

    GitHub repository with 88,850 stars and 13,056 forks.

    Trending score: 4.58; stars gained: +326; forks gained: +48.

    Language: Rust

  4. 4. tinyhumansai/openhuman

    Your Personal AI super intelligence. Private, Simple and extremely powerful.

    GitHub repository with 30,848 stars and 2,977 forks.

    Trending score: 4.37; stars gained: +332; forks gained: +50.

    Language: Rust

  5. 5. fallow-rs/fallow

    Codebase intelligence for TypeScript and JavaScript. Free static layer: unused code, duplication, circular deps, complexity hotspots, architecture boundaries. Optional paid runtime layer: hot-path review and cold-path deletion evidence from real production traffic. Rust-native, sub-second, zero-config framework support.

    GitHub repository with 3,081 stars and 94 forks.

    Trending score: 4.05; stars gained: +346; forks gained: +16.

    Language: Rust

    Topics: cli, code-duplication, code-quality, codebase-intelligence, copy-paste-detection, dead-code

  6. 6. aaif-goose/goose

    an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

    GitHub repository with 46,568 stars and 4,863 forks.

    Trending score: 3.80; stars gained: +152; forks gained: +28.

    Language: Rust

    Topics: acp, ai, ai-agents, mcp

Trending topic: anthropic

  1. 1. NousResearch/hermes-agent

    The agent that grows with you

    GitHub repository with 181,776 stars and 31,187 forks.

    Trending score: 5.95; stars gained: +1,867; forks gained: +361.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude

  2. 2. affaan-m/ECC

    The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

    GitHub repository with 207,683 stars and 31,870 forks.

    Trending score: 5.86; stars gained: +3,345; forks gained: +536.

    Language: JavaScript

    Topics: ai-agents, anthropic, claude, claude-code, developer-tools, llm

  3. 3. chopratejas/headroom

    Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answers. Library, proxy, MCP server.

    GitHub repository with 13,361 stars and 853 forks.

    Trending score: 5.69; stars gained: +2,829; forks gained: +175.

    Language: Python

    Topics: agent, ai, anthropic, compression, context-engineering, context-window

  4. 4. can1357/oh-my-pi

    ⌥ AI Coding agent for the terminal — hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more

    GitHub repository with 10,639 stars and 890 forks.

    Trending score: 4.82; stars gained: +560; forks gained: +62.

    Language: TypeScript

    Topics: ai-agent, ai-coding-agent, anthropic, bun, claude, cli

  5. 5. langchain-ai/langchain

    The agent engineering platform.

    GitHub repository with 138,559 stars and 22,957 forks.

    Trending score: 4.53; stars gained: +171; forks gained: +31.

    Language: Python

    Topics: agents, ai, ai-agents, anthropic, chatgpt, deepagents

  6. 6. HKUDS/nanobot

    Lightweight, open-source AI agent for your tools, chats, and workflows.

    GitHub repository with 43,713 stars and 7,735 forks.

    Trending score: 4.22; stars gained: +132; forks gained: +28.

    Language: Python

    Topics: ai, ai-agent, ai-agents, anthropic, chatgpt, claude