llm-routing repositories
Trending repositories tagged llm-routing, ranked by trending score. Updated daily.
-
1
mozilla-ai/otari
Open-source AI gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
GitHub · Python · 955 stars · 139 forks · +8 stars in 24 hours · Trending score 2.10
-
2
pvjbuilds/delegate-router
Claude Code and Codex CLI skill: an LLM router that delegates bulk, already-decided coding tasks to another model you already pay for (GPT via Codex, Gemini via agy, a Claude Opus subagent), on another subscription first. Benchmark-checked routes, cost per task measured on a bench, cross-model review. The host verifies every diff.
GitHub · Python · 43 stars · 9 forks · +10 stars in 24 hours · Trending score 1.78
-
3
lawrence3699/jev-style
JevStyle: local decision models for AI agents. Classify, route and score with a probability per option. systemone-compatible local server, MCP tools, Claude Code guard. Open weights, Apache-2.0.
GitHub · Python · 138 stars · 4 forks · +1 stars in 24 hours · Trending score 1.47
-
4
Akramovic1/jev-pilot
Let Jev steer Claude Code: the right reasoning effort, subagent model and skill for every prompt. A Claude Code plugin powered by TypeSafe's Jev (OpenRouter / TypeSafe).
GitHub · TypeScript · 13 stars · 2 forks · +5 stars in 24 hours · Trending score 1.20
-
5
0xNyk/council-of-high-intelligence
Structured multi-perspective deliberation for hard decisions. Run full councils, focused triads, or duo debates across Claude Code, Codex, Gemini CLI, and OpenCode.
GitHub · Shell · 4,853 stars · 457 forks · 0 stars in 24 hours · Trending score 0.87
-
6
OpenBMB/EC2-Bench
EC2-Bench (EC²-Bench): benchmark for edge-cloud collaboration in long-horizon LLM agents — task performance, resource usage & privacy exposure. arXiv 2610.17816
GitHub · Python · 24 stars · 0 forks · +2 stars in 24 hours · Trending score 0.81
-
7
CommonstackAI/TwinRouterBench
Per-step LLM routing benchmark with 970 static labels, live SWE-bench evaluation, an open data pipeline, and a public leaderboard.
GitHub · Python · 35 stars · 4 forks · 0 stars in 24 hours · Trending score 0.73
-
8
manomilano/orca-compass
Smart AI worker routing for Orca. Match agents, models, and reasoning effort to task complexity while optimizing usage across your existing subscriptions.
GitHub · TypeScript · 7 stars · 1 forks · +2 stars in 24 hours · Trending score 0.60
-
9
ankitvirdi4/awesome-llm-cost
Tools, libraries, papers, and patterns for reducing the cost of running large language models in production.
GitHub · 14 stars · 15 forks · 0 stars in 24 hours · Trending score 0.46
-
10
RouteWorks/RouterArena
RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.
GitHub · Python · 158 stars · 70 forks · 0 stars in 24 hours · Trending score 0.37
-
11
deltawi/deltallm
Self-hosted LLM gateway with SSO, audit logs, client access controls, routing, and usage tracking. OpenAI-compatible and MIT licensed.
GitHub · Python · 21 stars · 5 forks · 0 stars in 24 hours · Trending score 0.32
-
12
NeuralTrust/TrustGate
Open-source AI gateway for LLM and agent traffic — multi-provider routing, guardrails, semantic caching and MCP support. Written in Go.
GitHub · Go · 17 stars · 8 forks · 0 stars in 24 hours · Trending score 0.28
-
13
sauravsingla/agentweave
Pre-inference tool and agent routing for MCP, A2A and tool-rich LLM systems. Reduce candidate tools before model inference with policy-aware routing and recovery.
GitHub · Python · 42 stars · 36 forks · 0 stars in 24 hours · Trending score 0.28
-
14
dominicrico/jev-router
Claude Code plugin: automatic Claude model routing. Picks Haiku, Sonnet or Opus and the reasoning effort per prompt, step and subagent; effort cap, prompt-cache guard, status band, benchmarks.
GitHub · TypeScript · 20 stars · 2 forks · 0 stars in 24 hours · Trending score 0.22
-
15
Ninthless/StackFerry
Desktop provider manager and local failover router for Codex, Claude Code, and Grok.
GitHub · TypeScript · 31 stars · 4 forks · 0 stars in 24 hours · Trending score 0.18
-
16
emirhuseynrmx/calybris-core
Deterministic proof-carrying decision core with replay verification, WAL, and fixed-point budget proofs
GitHub · Rust · 14 stars · 0 forks · 0 stars in 24 hours · Trending score 0.15
-
17
surlymochan/swrm
Distributed heterogeneous agent task dispatcher — claim under lease, return with evidence. Quota-aware routing across Claude, Codex, OpenCode Go and DeepSeek, in isolated git worktrees with hard budgets.
GitHub · Python · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.10
-
18
tiagovilasboas/downshift-ai
Reduce token usage, optimize LLM costs, and route AI coding agents intelligently across Claude Code, Codex, Cursor, and other harnesses.
GitHub · Go · 6 stars · 1 forks · 0 stars in 24 hours · Trending score 0.10
-
19
ABCastor/crossfeed-orchestrator
Route AI coding work across the AI subscriptions you already pay for, with a local console and quota-aware switches.
GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.10
-
20
soulsteads/soulsteads-model-router
Blazing fast, capacity-aware routing for local AI. One OpenAI-compatible endpoint for your inference servers. Built in Rust. No BS.
GitHub · Rust · 5 stars · 2 forks · 0 stars in 24 hours · Trending score 0.09
-
21
Burakkylmz/llm-routing-evaluation-platform
Open-source LLM routing evaluation platform benchmarking cost, latency, quality, and safety across routing strategies, with a focus on Turkish banking.
GitHub · Python · 12 stars · 3 forks · 0 stars in 24 hours · Trending score 0.04
-
22
angel291592/Intent-Router
Intent compiler for AI agents — converges vague requests into typed IntentSpec contracts (probe, ask, or halt before routing), the input layer for routers and typed-decision models like Jev & Laya
GitHub · Python · 94 stars · 18 forks · 0 stars in 24 hours · Trending score 0.02
-
23
tiagovilasboas/downshift
Reduce token usage and LLM API cost in AI coding agents: compact verbose command output, right-size subagent models, flag wasted prompt cache. Deterministic, fail-open hooks for Claude Code, Cursor, Codex and OpenCode. No LLM in the loop.
GitHub · Go · 8 stars · 0 forks · 0 stars in 24 hours · Trending score 0.00
-
24
junchenzhi/Awesome-LLM-Ensemble
A curated list of Awesome-LLM-Ensemble papers for the survey "Harnessing Multiple Large Language Models: A Survey on LLM Ensemble"
GitHub · HTML · 256 stars · 21 forks · 0 stars in 24 hours · Trending score 0.00