inference-gateway/inference-gateway
An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.
GitHub repository with 124 stars and 21 forks.
Language: Go
Topics: agnostic, anthropic, api, cohere, deepseek-v4-pro, gateway, gateway-api, golang, inference-api, kubernetes