ai-gateway repositories
Trending repositories tagged ai-gateway, ranked by trending score. Updated daily.
-
1
cheaper-inference/OmniRoute
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
GitHub · TypeScript · 89,118 stars · 13,772 forks · +538 stars in 24 hours · Trending score 5.36
-
2
Continuum-AI-Corp/OrcaRouter-Lite
Self-hosted LLM router with a managed safety net. OpenAI-compatible. BYOK. Single-workspace. Streaming. For more advanced routing choose hosted OrcaRouter
GitHub · Python · 3,549 stars · 488 forks · +137 stars in 24 hours · Trending score 4.46
-
3
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
GitHub · Python · 63,615 stars · 13,444 forks · +122 stars in 24 hours · Trending score 4.24
-
4
QuantumNous/new-api
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
GitHub · Go · 52,272 stars · 12,764 forks · +135 stars in 24 hours · Trending score 4.21
-
5
decolua/9router
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
GitHub · JavaScript · 32,666 stars · 6,406 forks · +77 stars in 24 hours · Trending score 3.86
-
6
langfuse/langfuse
🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
GitHub · TypeScript · 37,673 stars · 4,280 forks · +85 stars in 24 hours · Trending score 3.85
-
7
maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
GitHub · Go · 9,800 stars · 1,628 forks · +73 stars in 24 hours · Trending score 3.67
-
8
lidge-jun/opencodex
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code
GitHub · TypeScript · 18,683 stars · 1,536 forks · +55 stars in 24 hours · Trending score 3.63
-
9
respanai/respan-gateway
Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.
GitHub · Rust · 955 stars · 145 forks · +60 stars in 24 hours · Trending score 3.57
-
10
fosrl/pangolin
Modern networking and security platform providing secure access and connectivity to apps, infrastructure, and AI workloads. Connect and protect your users.
GitHub · TypeScript · 23,903 stars · 851 forks · +48 stars in 24 hours · Trending score 3.51
-
11
agentgateway/agentgateway
Next Generation Agentic Proxy for AI Agents and MCP servers
GitHub · Rust · 6,326 stars · 1,120 forks · +48 stars in 24 hours · Trending score 3.38
-
12
yreidev/workbuddy2api-panel
把腾讯 WorkBuddy 账号变成 OpenAI 兼容 API 的多账号网关。请求头照官方桌面端逐项对齐,主备入口 + HTTPDNS 自动切换,国内 / 国际双域合池,企业号可用 Claude,签到与成长任务全自动,React 管理面板支持一键更新。原版 workbuddy2api-panel 的持续同步增强版,Docker / 单文件部署。
GitHub · Go · 122 stars · 25 forks · +51 stars in 24 hours · Trending score 3.13
-
13
casdoor/casdoor
An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD
GitHub · Go · 14,903 stars · 1,927 forks · +24 stars in 24 hours · Trending score 2.87
-
14
apimartdfm2/ai-gateway-directory
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
GitHub · Python · 81 stars · 0 forks · +50 stars in 24 hours · Trending score 2.78
-
15
yanstd888/9routerx
9RouterX (9R Next Go Generation): Single-binary Go AI router, LLM gateway & 20-40% token saver. Route Claude Code, Cursor & Codex across 155 providers, 28 OAuth & 248 free models (24 keyless) — OpenAI, Claude, Gemini, DeepSeek, Groq, Ollama & MCP.
GitHub · Go · 256 stars · 158 forks · +6 stars in 24 hours · Trending score 2.74
-
16
vllm-project/semantic-router
An open, programmable decision layer for models and compute.
GitHub · Go · 6,513 stars · 1,141 forks · +17 stars in 24 hours · Trending score 2.66
-
17
nejib1/Free-LLM
74 free LLM API providers & 450+ free models (limits, no-card options) + Free-LLM Router: all of them behind one OpenAI/Anthropic-compatible endpoint with instant failover. Run Claude Code, Codex, Cursor, Aider on free models. Gemini, Groq, Mistral, DeepSeek, Qwen & more. Synced daily.
GitHub · JavaScript · 1,073 stars · 139 forks · +19 stars in 24 hours · Trending score 2.62
-
18
loxilb-io/loxilb-inference-gateway
Inference-aware L4/L7 load balancer for LLM serving fleets, forked from loxilb
GitHub · Go · 72 stars · 14 forks · +18 stars in 24 hours · Trending score 2.62
-
19
apimartm9z3il3u/ai-gateway-catalog
AI API gateway / relay: 307 models behind one OpenAI-compatible key. image2.5 $0.0085/image, Seedance 2.0 Mini $0.01056/sec, LLM from $0.0228/M tokens. USD settlement, pay-as-you-go, $1 minimum top-up.
GitHub · Python · 78 stars · 0 forks · +39 stars in 24 hours · Trending score 2.58
-
20
apache/apisix
The Cloud-Native API Gateway and AI Gateway
GitHub · Lua · 17,354 stars · 3,013 forks · +23 stars in 24 hours · Trending score 2.58
-
21
WizisCool/oh-my-cpa
Modern web console for CLIProxyAPI v8+ with provider and OAuth management, live routing, request analytics, pricing, and MCP.
GitHub · TypeScript · 469 stars · 51 forks · +8 stars in 24 hours · Trending score 2.34
-
22
theagentrouter/agent-router
Manages Unified Access to Generative AI Services built on Envoy Gateway
GitHub · Go · 2,423 stars · 474 forks · +10 stars in 24 hours · Trending score 2.28
-
23
shuishuipingan/trae2api-hub
Trea国际国内多账号反代网关,Trae 国际/国内双区多账号 OpenAI 兼容网关 — 直连推理、账号池、模型目录、额度预警/自动降级、API Key 配额与白名单、图形化看板、Docker 零依赖
GitHub · Python · 67 stars · 18 forks · +8 stars in 24 hours · Trending score 2.26
-
24
tbphp/gpt-load
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。
GitHub · Go · 7,239 stars · 796 forks · +14 stars in 24 hours · Trending score 2.21