maximhq/bifrost
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
GitHub repository with 8,096 stars and 1,218 forks.
Language: Go
Topics: gateway, llm, llm-gateway, mcp-client, mcp-server, guardrails, mcp-gateway, ai-gateway, gateway-services, generative-ai