lianluo-esign/ferrogate
Open-source Rust/Pingora AI gateway and reverse proxy for self-hosted LLM traffic control: OpenAI-compatible Chat/Responses, provider routing/fallback, virtual API keys, policy and budgets, exact-match cache, MCP/tool execution, observability, Admin APIs/dashboard, cluster ops, and automatic HTTPS.
GitHub repository with 15 stars and 2 forks.
Language: Rust
Topics: ai, aigateway, reverse-proxy, ai-gateway, infrastructure, ai-agent, ai-tools, api-gateway, bifrost, mcp-gateway