llm-proxy repositories

Trending repositories tagged llm-proxy, ranked by trending score. Updated daily.

  1. 1
    maximhq/bifrost

    Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.

    GitHub · Go · 9,800 stars · 1,628 forks · +73 stars in 24 hours · Trending score 3.67

  2. 2
    lidge-jun/opencodex

    Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude Code

    GitHub · TypeScript · 18,680 stars · 1,535 forks · +55 stars in 24 hours · Trending score 3.63

  3. 3
    respanai/respan-gateway

    Open-source LLM gateway in Rust. One endpoint for OpenAI, Anthropic, Gemini and every other vendor. Any SDK, any model, any tool.

    GitHub · Rust · 955 stars · 145 forks · +60 stars in 24 hours · Trending score 3.57

  4. 4
    shuishuipingan/trae2api-hub

    Trea国际国内多账号反代网关,Trae 国际/国内双区多账号 OpenAI 兼容网关 — 直连推理、账号池、模型目录、额度预警/自动降级、API Key 配额与白名单、图形化看板、Docker 零依赖

    GitHub · Python · 67 stars · 18 forks · +8 stars in 24 hours · Trending score 2.26

  5. 5
    mozilla-ai/otari

    Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

    GitHub · Python · 955 stars · 138 forks · +8 stars in 24 hours · Trending score 2.10

  6. 6
    GetBusbar/busbar

    The execution control plane for AI agents. Govern every model request, MCP tool call, A2A delegation, and downstream action—while keeping your native protocols intact: six native LLM protocols in, six native LLM protocols out.

    GitHub · Rust · 227 stars · 25 forks · +7 stars in 24 hours · Trending score 1.78

  7. 7
    PlaygrndLabs/sub2api

    A Cloudflare-based LLM gateway and proxy server. Literally the CLIProxyAPI (CPA) project, deployed as a Cloudflare Worker in one click.

    GitHub · TypeScript · 18 stars · 9 forks · +8 stars in 24 hours · Trending score 1.78

  8. 8
    LeenHawk/gproxy

    gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude / Gemini-style APIs through a unified gateway, with a built-in admin console, user/key management, and request/usage auditing.

    GitHub · Rust · 297 stars · 54 forks · +5 stars in 24 hours · Trending score 1.72

  9. 9
    TsinHzl/kiro2cc-proxy

    Kiro 代理到 Claude Code 与 Codex,支持 Claude Opus 5.5/5/4.8/4.7/4.6、Sonnet 5.5/5/4.6、Haiku 5.5、GPT-5.6、Kimi K3、Grok-4.7,支持前缀缓存,并支持 SSE 流式输出。Kiro proxy for Claude Code and Codex. Supports Claude Opus 5.5/5/4.8/4.7/4.6, Sonnet 5.5/5/4.6, Haiku5.5,GPT-5.6, Kimi K3,Grok-4.7, Supports Prefix Cache, and SSE streaming.

    GitHub · Rust · 357 stars · 61 forks · +7 stars in 24 hours · Trending score 1.55

  10. 10
    theopenco/llmgateway

    Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

    GitHub · TypeScript · 1,753 stars · 201 forks · +5 stars in 24 hours · Trending score 1.54

  11. 11
    liaohch3/claude-tap

    Intercept and inspect Coding Agent API traffic from Claude Code, Codex CLI, Gemini CLI, Cursor CLI, OpenCode, Kimi/Kimi Code, Pi, and Hermes in a local trace viewer.

    GitHub · Python · 3,355 stars · 292 forks · +3 stars in 24 hours · Trending score 1.51

  12. 12
    ThinkWatchProject/ThinkWatch-Lite

    Local gateway for Claude Code, Codex and other AI clients on macOS, Windows and Linux: switch upstreams without touching clients, keep API keys from relays, cut off malicious tool calls, trace every request.

    GitHub · TypeScript · 1,073 stars · 8 forks · +2 stars in 24 hours · Trending score 1.40

  13. 13
    IngARodriguez/openapis

    Free Claude API + free OpenAI API in one unified proxy. Drop-in compatible with Anthropic SDK, OpenAI SDK, Claude Code CLI, OpenCode, LangChain. 100+ models (Claude Opus 4.7, Sonnet 4.6, Haiku 4.5, GPT-5.5, GPT-5.4-mini, GPT-5.3-codex). Open beta — totally free.

    GitHub · 103 stars · 16 forks · 0 stars in 24 hours · Trending score 1.30

  14. 14
    shuishuipingan/qoder2api-hub

    Qoder国际国内多账号反代网关,Qoder 国际国内双区多账号 OpenAI 兼容网关中枢 — COSY 签名推理、稳定设备指纹防风控、OAuth 设备授权免客户端登录、每日签到与 Pro 福利、后台定时调度器、Web 监控看板,支持 Codex / Claude Code 与标准 OpenAI 客户端

    GitHub · Python · 583 stars · 149 forks · 0 stars in 24 hours · Trending score 1.24

  15. 15
    api7/aisix

    Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

    GitHub · Rust · 229 stars · 47 forks · +3 stars in 24 hours · Trending score 1.16

  16. 16
    kittors/CliRelay

    Self-hosted AI gateway for coding CLIs — one OpenAI/Claude/Gemini/Codex-compatible endpoint, with a multi-tenant web console, request logs, and spend quotas.

    GitHub · Go · 1,060 stars · 134 forks · +2 stars in 24 hours · Trending score 0.98

  17. 17
    vayungodara/cliproxy-rs

    Use DeepSeek, GLM, Kimi, OpenRouter and more in Codex CLI and Claude Code: one local endpoint, API translation, failover. Single Rust binary, CLIProxyAPI-compatible.

    GitHub · Rust · 78 stars · 12 forks · 0 stars in 24 hours · Trending score 0.84

  18. 18
    miaocell/magpie-doubao-work-auth

    无需登录豆包客户端、本机无需下载豆包工作,把豆包工作订阅变成 magpie 上的 9 个模型:豆包 / DeepSeek / Kimi / GLM,带真实倍率与上下文,支持多账号

    GitHub · JavaScript · 28 stars · 8 forks · +4 stars in 24 hours · Trending score 0.83

  19. 19
    lszyk26/wb2api

    Turn a pool of WorkBuddy / CodeBuddy accounts into one OpenAI-compatible API. Go + Vue 3, single binary, with users, quotas, billing, API keys, payments and an account-pool admin panel.

    GitHub · Vue · 24 stars · 1 forks · +1 stars in 24 hours · Trending score 0.75

  20. 20
    NadirRouter/NadirClaw

    Source-available LLM router and AI cost optimizer. Routes simple prompts to cheap or local models and complex ones to premium models, automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor and OpenClaw. Self-hosted, no middleman.

    GitHub · Python · 666 stars · 78 forks · +2 stars in 24 hours · Trending score 0.73

  21. 21
    askalf/dario

    One local endpoint that routes Claude Code, Cursor, Cline, Aider, Codex CLI and the SDKs through the Claude and ChatGPT plans you already pay for: seats first, then the fallback chain you configure, and a ledger of who paid. Zero runtime dependencies.

    GitHub · JavaScript · 592 stars · 78 forks · +1 stars in 24 hours · Trending score 0.73

  22. 22
    cuihuan/awesome-ai-gateway

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    GitHub · HTML · 158 stars · 152 forks · 0 stars in 24 hours · Trending score 0.69

  23. 23
    logicplanes/kaeso

    Self-hosted AI gateway in Rust: one OpenAI-, Anthropic-, Gemini- and ElevenLabs-compatible API for chat, images, video, speech and music on every provider, with SSO, roles, budgets, alias routes, request logs, a playground and an MCP portal.

    GitHub · Rust · 19 stars · 3 forks · 0 stars in 24 hours · Trending score 0.68

  24. 24
    HanHan666666/codebuddy2openai

    Convert CodeBuddy/WorkBuddy (Tencent coding assistant) subscription into an OpenAI-compatible API. Use CodeBuddy GLM-5.2/Kimi/DeepSeek models in Codex CLI or any OpenAI client. Cross-platform, single-file, no auth changes.

    GitHub · Python · 91 stars · 21 forks · 0 stars in 24 hours · Trending score 0.67