Lincoln-cn/JAiRouter
JAiRouter is a Spring Boot based model service routing and load balancing gateway used for unified management and routing of various AI model services (such as Chat, Embedding, Rerank, TTS, etc.), supporting multiple load balancing strategies.
GitHub repository with 11 stars and 4 forks.
Language: Java
Topics: ai, java, llm, maas, modelasservice, router, springboot