Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
Load Balancing GitHub Repositories (2026) · Open Source Tools
Discover the best Load Balancing open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.
Use all your network adapters at once on Windows/Linux/Mac: per-connection load balancing over Wi-Fi, Ethernet and phone/USB tethers (TUN + Wintun)
The ultimate datacenter management solution for Proxmox VE and XCP-NG. Unified multi-cluster control, intelligent load balancing, and seamless cross-cluster VM migrations — all in one beautiful interface.
Net Switch: per-app internet for Windows. Choose which connection each app uses, combine your lines, and fail over automatically.
The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
LudicrousDB is an advanced database interface for WordPress that supports replication, failover, load balancing, & partitioning
State-of-the-art Framework 🏗 for Cloud Computing ⛅️ Simulation: a modern, full-featured, easier-to-use, highly extensible 🧩, faster 🚀 and more accurate ☕️ Java 25+ tool for cloud computing research 🎓 Examples: https://github.com/cloudsimplus/cloudsimplus-examples