radlab-dev-group/llm-router
LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).
GitHub repository with 10 stars and 3 forks.
Language: Python
Topics: automation, cloud, genai, llm, llm-balancing, llm-gateway, llm-gateway-system, llm-router, llm-router-models, llm-router-plugins