llm-proxy repositories
Trending repositories tagged llm-proxy, ranked by trending score. Updated daily.
-
1
maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
GitHub · Go · 9,800 stars · 1,628 forks · +73 stars in 24 hours · Trending score 3.67
-
2
lidge-jun/opencodex
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
GitHub · TypeScript · 18,680 stars · 1,535 forks · +55 stars in 24 hours · Trending score 3.63
-
3
respanai/respan-gateway
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
GitHub · Rust · 955 stars · 145 forks · +60 stars in 24 hours · Trending score 3.57
-
4
shuishuipingan/trae2api-hub
Trea国际国内多账号反代网关,Trae 国际/国内双区多账号 OpenAI 兼容网关 — 直连推理、账号池、模型目录、额度预警/自动降级、API Key 配额与白名单、图形化看板、Docker 零依赖
GitHub · Python · 67 stars · 18 forks · +8 stars in 24 hours · Trending score 2.26
-
5
mozilla-ai/otari
Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
GitHub · Python · 955 stars · 138 forks · +8 stars in 24 hours · Trending score 2.10
-
6
GetBusbar/busbar
The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.
GitHub · Rust · 227 stars · 25 forks · +7 stars in 24 hours · Trending score 1.78
-
7
PlaygrndLabs/sub2api
A Cloudflare-based LLM gateway and proxy server. Literally the CLIProxyAPI (CPA) project, deployed as a Cloudflare Worker in one click.
GitHub · TypeScript · 18 stars · 9 forks · +8 stars in 24 hours · Trending score 1.78
-
8
LeenHawk/gproxy
gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude / Gemini-style APIs through a unified gateway, with a built-in admin console, user/key management, and request/usage auditing.
GitHub · Rust · 297 stars · 54 forks · +5 stars in 24 hours · Trending score 1.72
-
9
TsinHzl/kiro2cc-proxy
Kiro 代理到 Claude Code 与 Codex,支持 Claude Opus 5.5/5/4.8/4.7/4.6、Sonnet 5.5/5/4.6、Haiku 5.5、GPT-5.6、Kimi K3、Grok-4.7,支持前缀缓存,并支持 SSE 流式输出。Kiro proxy for Claude Code and Codex. Supports Claude Opus 5.5/5/4.8/4.7/4.6, Sonnet 5.5/5/4.6, Haiku5.5,GPT-5.6, Kimi K3,Grok-4.7, Supports Prefix Cache, and SSE streaming.
GitHub · Rust · 357 stars · 61 forks · +7 stars in 24 hours · Trending score 1.55
-
10
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
GitHub · TypeScript · 1,753 stars · 201 forks · +5 stars in 24 hours · Trending score 1.54
-
11
liaohch3/claude-tap
Intercept and inspect Coding Agent API traffic from Claude Code, Codex CLI, Gemini CLI, Cursor CLI, OpenCode, Kimi/Kimi Code, Pi, and Hermes in a local trace viewer.
GitHub · Python · 3,355 stars · 292 forks · +3 stars in 24 hours · Trending score 1.51
-
12
ThinkWatchProject/ThinkWatch-Lite
Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.
GitHub · TypeScript · 1,073 stars · 8 forks · +2 stars in 24 hours · Trending score 1.40
-
13
IngARodriguez/openapis
Free Claude API + free OpenAI API in one unified proxy. Drop-in compatible with Anthropic SDK, OpenAI SDK, Claude Code CLI, OpenCode, LangChain. 100+ models (Claude Opus 4.7, Sonnet 4.6, Haiku 4.5, GPT-5.5, GPT-5.4-mini, GPT-5.3-codex). Open beta — totally free.
GitHub · 103 stars · 16 forks · 0 stars in 24 hours · Trending score 1.30
-
14
shuishuipingan/qoder2api-hub
Qoder国际国内多账号反代网关,Qoder 国际国内双区多账号 OpenAI 兼容网关中枢 — COSY 签名推理、稳定设备指纹防风控、OAuth 设备授权免客户端登录、每日签到与 Pro 福利、后台定时调度器、Web 监控看板,支持 Codex / Claude Code 与标准 OpenAI 客户端
GitHub · Python · 583 stars · 149 forks · 0 stars in 24 hours · Trending score 1.24
-
15
api7/aisix
Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.
GitHub · Rust · 229 stars · 47 forks · +3 stars in 24 hours · Trending score 1.16
-
16
kittors/CliRelay
Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.
GitHub · Go · 1,060 stars · 134 forks · +2 stars in 24 hours · Trending score 0.98
-
17
vayungodara/cliproxy-rs
Use DeepSeek, GLM, Kimi, OpenRouter and more in Codex CLI and Claude Code: one local endpoint, API translation, failover. Single Rust binary, CLIProxyAPI-compatible.
GitHub · Rust · 78 stars · 12 forks · 0 stars in 24 hours · Trending score 0.84
-
18
miaocell/magpie-doubao-work-auth
无需登录豆包客户端、本机无需下载豆包工作,把豆包工作订阅变成 magpie 上的 9 个模型:豆包 / DeepSeek / Kimi / GLM,带真实倍率与上下文,支持多账号
GitHub · JavaScript · 28 stars · 8 forks · +4 stars in 24 hours · Trending score 0.83
-
19
lszyk26/wb2api
Turn a pool of WorkBuddy / CodeBuddy accounts into one OpenAI-compatible API. Go + Vue 3, single binary, with users, quotas, billing, API keys, payments and an account-pool admin panel.
GitHub · Vue · 24 stars · 1 forks · +1 stars in 24 hours · Trending score 0.75
-
20
NadirRouter/NadirClaw
Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.
GitHub · Python · 666 stars · 78 forks · +2 stars in 24 hours · Trending score 0.73
-
21
askalf/dario
One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies.
GitHub · JavaScript · 592 stars · 78 forks · +1 stars in 24 hours · Trending score 0.73
-
22
cuihuan/awesome-ai-gateway
⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.
GitHub · HTML · 158 stars · 152 forks · 0 stars in 24 hours · Trending score 0.69
-
23
logicplanes/kaeso
Self-hosted AI gateway in Rust: one OpenAI-, Anthropic-, Gemini- and ElevenLabs-compatible API for chat, images, video, speech and music on every provider, with SSO, roles, budgets, alias routes, request logs, a playground and an MCP portal.
GitHub · Rust · 19 stars · 3 forks · 0 stars in 24 hours · Trending score 0.68
-
24
HanHan666666/codebuddy2openai
Convert CodeBuddy/WorkBuddy (Tencent coding assistant) subscription into an OpenAI-compatible API. Use CodeBuddy GLM-5.2/Kimi/DeepSeek models in Codex CLI or any OpenAI client. Cross-platform, single-file, no auth changes.
GitHub · Python · 91 stars · 21 forks · 0 stars in 24 hours · Trending score 0.67