qiniu/xhub
A self-hosted AI gateway for enterprises. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
GitHub repository with 71 stars and 2 forks.
Language: TypeScript
Topics: ai-gateway, anthropic, gemini, litellm, openai, seeddance, tokenhub