llm-gateway repositories
Trending repositories tagged llm-gateway, ranked by trending score. Updated daily.
-
1
cheaper-inference/OmniRoute
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
GitHub · TypeScript · 89,118 stars · 13,772 forks · +538 stars in 24 hours · Trending score 5.36
-
2
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
GitHub · Python · 63,615 stars · 13,444 forks · +122 stars in 24 hours · Trending score 4.24
-
3
QuantumNous/new-api
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
GitHub · Go · 52,272 stars · 12,764 forks · +135 stars in 24 hours · Trending score 4.21
-
4
decolua/9router
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
GitHub · JavaScript · 32,666 stars · 6,406 forks · +77 stars in 24 hours · Trending score 3.86
-
5
langfuse/langfuse
🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
GitHub · TypeScript · 37,673 stars · 4,280 forks · +85 stars in 24 hours · Trending score 3.85
-
6
maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
GitHub · Go · 9,800 stars · 1,628 forks · +73 stars in 24 hours · Trending score 3.67
-
7
respanai/respan-gateway
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
GitHub · Rust · 955 stars · 145 forks · +60 stars in 24 hours · Trending score 3.57
-
8
yreidev/workbuddy2api-panel
把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。
GitHub · Go · 122 stars · 25 forks · +51 stars in 24 hours · Trending score 3.13
-
9
yanstd888/9routerx
9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
GitHub · Go · 256 stars · 158 forks · +6 stars in 24 hours · Trending score 2.74
-
10
tbphp/gpt-load
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
GitHub · Go · 7,239 stars · 796 forks · +14 stars in 24 hours · Trending score 2.21
-
11
mozilla-ai/otari
Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
GitHub · Python · 955 stars · 139 forks · +8 stars in 24 hours · Trending score 2.10
-
12
Kong/kong
🦍 The API and AI Gateway
GitHub · Lua · 44,402 stars · 5,246 forks · +9 stars in 24 hours · Trending score 2.02
-
13
apimartemk4bsg0/llm-gateway-migration-kit
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
GitHub · Python · 60 stars · 0 forks · +15 stars in 24 hours · Trending score 1.93
-
14
GetBusbar/busbar
The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.
GitHub · Rust · 227 stars · 25 forks · +7 stars in 24 hours · Trending score 1.78
-
15
PlaygrndLabs/sub2api
A Cloudflare-based LLM gateway and proxy server. Literally the CLIProxyAPI (CPA) project, deployed as a Cloudflare Worker in one click.
GitHub · TypeScript · 18 stars · 9 forks · +8 stars in 24 hours · Trending score 1.78
-
16
ebouther/opencode-unlimited-proxy
OpenAI-compatible gateway for the OpenCode free tier. Works around 403 FreeTierError with a de-duplicated pool of rotating egress IPs. No API key, no cost.
GitHub · Python · 87 stars · 19 forks · +4 stars in 24 hours · Trending score 1.74
-
17
ShawTim/gemini-app2api
Zero-dependency native Gemini HTTP/2 gateway & in-process Pi extension (pi-gemini-app) connecting Gemini subscriptions to OpenAI-compatible coding agents (Cursor, Cline, Codex, Pi) with multi-account pooling.
GitHub · JavaScript · 70 stars · 10 forks · +29 stars in 24 hours · Trending score 1.72
-
18
dromara/five-api
轻量企业级 AI 网关:给部门和团队分额度,高性能,审计与泄密防护全部开源。Lightweight enterprise AI gateway: budgets for every team, high performance, audit and leak protection fully open source.
GitHub · Python · 40 stars · 5 forks · +3 stars in 24 hours · Trending score 1.55
-
19
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
GitHub · TypeScript · 1,753 stars · 201 forks · +5 stars in 24 hours · Trending score 1.54
-
20
TykTechnologies/tyk
Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
GitHub · Go · 10,896 stars · 1,172 forks · +5 stars in 24 hours · Trending score 1.46
-
21
ThinkWatchProject/ThinkWatch-Lite
Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.
GitHub · TypeScript · 1,073 stars · 8 forks · +2 stars in 24 hours · Trending score 1.40
-
22
api7/aisix
Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.
GitHub · Rust · 229 stars · 47 forks · +3 stars in 24 hours · Trending score 1.16
-
23
ENTERPILOT/GoModel
AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.
GitHub · Go · 1,324 stars · 136 forks · +1 stars in 24 hours · Trending score 1.09
-
24
sksarvesh007/antiglaude
Production compatibility gateway bridge & observability platform connecting Claude Code CLI with Google Antigravity & Gemini inference models via Anthropic Messages API
GitHub · Python · 176 stars · 25 forks · +2 stars in 24 hours · Trending score 1.09