MCPs tagged with load balancing
-
Apache APISIX
Dynamic, high-performance API Gateway with AI and Model Context Protocol support
Apache APISIX is a real-time, high-performance API gateway that offers advanced traffic management features such as load balancing, dynamic routing, and authentication. It serves as both a traditional API gateway and an AI Gateway, supporting seamless proxying for AI workloads and managing LLM traffic. Notably, it includes the 'mcp-bridge' plugin, which allows for integration and conversion of stdio-based Model Context Protocol (MCP) servers to scalable HTTP SSE services, enabling robust context management for AI applications.
- ⭐ 15,837
- MCP
- apache/apisix
-
McGravity
Unified load balancer and proxy for multiple MCP servers
McGravity acts as a scalable unified proxy and load balancer for multiple MCP (Model Context Protocol) servers. It allows clients to connect through a single endpoint to access and manage multiple MCP servers efficiently. The tool offers load balancing, configuration via YAML, CLI and Docker support, and plans to evolve with features such as health checks and a web interface. Designed for modern GenAI infrastructure, it simplifies connection, balancing, and scalability of MCP server deployments.
- ⭐ 68
- MCP
- tigranbs/mcgravity