load-balancing repositories
Trending repositories tagged load-balancing, ranked by trending score. Updated daily.
-
1
maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
GitHub · Go · 9,800 stars · 1,628 forks · +73 stars in 24 hours · Trending score 3.67
-
2
net-merge/net-merge
Use all your internet connections at once on Windows, macOS, Linux and Android: per-connection load balancing over Wi-Fi, Ethernet, mobile data and phone tethers
GitHub · Go · 3,445 stars · 197 forks · +70 stars in 24 hours · Trending score 3.57
-
3
PegaProx/project-pegaprox
The ultimate datacenter management solution for Proxmox VE and XCP-NG. Unified multi-cluster control, intelligent load balancing, and seamless cross-cluster VM migrations — all in one beautiful interface.
GitHub · Python · 1,731 stars · 131 forks · 0 stars in 24 hours · Trending score 1.13
-
4
kekawia/net-switch
Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.
GitHub · Go · 102 stars · 5 forks · +1 stars in 24 hours · Trending score 0.72
-
5
adminsyspro/proxcenter-ui
ProxCenter is an alternative to VMware vCenter for Proxmox environments. It provides a modern, intuitive web interface to manage multiple Proxmox VE clusters and Proxmox Backup Server instances from a single pane of glass.
GitHub · TypeScript · 1,779 stars · 120 forks · 0 stars in 24 hours · Trending score 0.67
-
6
net-merge/android
net-merge for Android: use Wi-Fi and mobile data at the same time. No root, no account, no server.
GitHub · Go · 24 stars · 3 forks · 0 stars in 24 hours · Trending score 0.63
-
7
autcir/openvidia
Multi-key proxy for NVIDIA NIM with a native desktop dashboard — auto-rotation, cooldown, RPM limiting, Claude Code + Codex CLI + opencode support. Free-tier keys pooled behind one endpoint.
GitHub · Python · 9 stars · 1 forks · 0 stars in 24 hours · Trending score 0.38
-
8
Kame696/kame-api-rotation-for-agent-zero
🐢⚡ The best free API key rotation + automatic model fallback for Agent Zero. Many keys and models as one pool: every 429 / RESOURCE_EXHAUSTED read, each key rested exactly as long as needed, a late reply raced by your next model. Gemini, OpenAI, OpenRouter, any provider.
GitHub · Python · 24 stars · 3 forks · 0 stars in 24 hours · Trending score 0.33
-
9
HariSekhon/Diagrams-as-Code
Cloud & DevOps Architecture Diagrams-as-Code in Python, D2 and MermaidJS languages
GitHub · D2 · 284 stars · 56 forks · 0 stars in 24 hours · Trending score 0.31
-
10
shuishuipingan/workbuddy-qoder-trae-hub
WorkBuddy x Qoder x Trae 三引擎融合网关:一个 Python 进程跑三家引擎、一个端口(8817)对外、一把合并 Key 按模型/区域自动选路并在 401/429/502/503/504 时跨引擎故障转移;兼容 OpenAI Chat/Responses 与 Anthropic Messages(SSE 流式),合并 Key 支持模型/引擎作用域;内置 React 面板:账号池(签到/积分/出口)、模型清单、数据指标(区间/KPI/热力图/缓存命中)、请求流水、网关 Key、福利中心、设置与一键更新;MIT 开源,支持 Docker/ghcr。
GitHub · Python · 11 stars · 2 forks · 0 stars in 24 hours · Trending score 0.24
-
11
Lincoln-cn/JAiRouter
Self-hosted LLM gateway for Java and Spring Boot teams: one OpenAI-compatible endpoint in front of Ollama, vLLM, GPUStack and cloud models, with RBAC, rate limiting, circuit breaking, audit and a visual console.
GitHub · Java · 27 stars · 11 forks · 0 stars in 24 hours · Trending score 0.24
-
12
majiayu000/litellm-rs
Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.
GitHub · Rust · 124 stars · 18 forks · 0 stars in 24 hours · Trending score 0.23
-
13
azrtydxb/Fastllm-proxy
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
GitHub · Rust · 109 stars · 93 forks · 0 stars in 24 hours · Trending score 0.17
-
14
cloudsimplus/cloudsimplus
State-of-the-art Framework 🏗 for Cloud Computing ⛅️ Simulation: a modern, full-featured, easier-to-use, highly extensible 🧩, faster 🚀 and more accurate ☕️ Java 25+ tool for cloud computing research 🎓 Examples: https://github.com/cloudsimplus/cloudsimplus-examples
GitHub · Java · 493 stars · 214 forks · −1 stars in 24 hours · Trending score 0.16
-
15
jaxernst/lasso-rpc
Fault-tolerant Ethereum JSON-RPC proxy with intelligent, low-latency, and deeply configurable routing. Lasso gives you fine grained control to make your blockchain apps faster, cheaper, and more reliable
GitHub · Elixir · 36 stars · 5 forks · 0 stars in 24 hours · Trending score 0.10
-
16
modcluster/mod_cluster
mod_cluster is an intelligent native Apache httpd-based and pure-Java Undertow-based load-balancer
GitHub · Java · 105 stars · 80 forks · 0 stars in 24 hours · Trending score 0.08
-
17
himanshu231204/system-design-fundamentals
Learn system design by breaking a real service. 16 runnable, dependency-free concept demos + one RAG API evolved through 6 stages — statelessness, caching, queues, backpressure, replicas, load balancing, observability. Every number measured, not asserted.
GitHub · Python · 5 stars · 0 forks · 0 stars in 24 hours · Trending score 0.06
-
18
quinoacomputing/quinoa
Adaptive computational fluid dynamics
GitHub · C++ · 115 stars · 25 forks · 0 stars in 24 hours · Trending score 0.04
-
19
intelligentwolf/WolfScale
Free tools for building robust, clustered server infrastructure — WolfStack, WolfScale, WolfDisk, WolfNet
GitHub · Rust · 304 stars · 27 forks · 0 stars in 24 hours · Trending score 0.00
-
20
junkurihara/rust-rpxy
A simple and ultrafast http reverse proxy serving multiple domain names and terminating TLS for http/1.1, 2 and 3, written in Rust
GitHub · Rust · 786 stars · 68 forks · 0 stars in 24 hours · Trending score 0.00
-
21
MaskingTechnology/jitar
Distributed runtime for JavaScript and TypeScript
GitHub · TypeScript · 167 stars · 14 forks · 0 stars in 24 hours · Trending score 0.00
-
22
openziti/llm-gateway
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual API keys, and end-to-end encryption via OpenZiti
GitHub · Go · 100 stars · 11 forks · 0 stars in 24 hours · Trending score 0.00
-
23
k8snetworkplumbingwg/bond-cni
Bond-cni is for fail-over and high availability of networking in cloudnative orchestration
GitHub · Go · 77 stars · 32 forks · 0 stars in 24 hours · Trending score 0.00
-
24
yolorouter/yolorouter
A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.
GitHub · Go · 207 stars · 5 forks · 0 stars in 24 hours · Trending score 0.00