Connection service discovery and load rebalancing

Abstract

The invention discloses a connection service discovery and load rebalancing. In a networked data system, a discovery protocol enables clients to establish connections to one a plurality of database servers to utilize a distributed connection service. The service manages connections between application servers, i.e. clients, and databases. An initial request from the client is received by a load balancer. The load balancer responds to the client by identifying an assigned connection to one of the database servers based on load considerations. The client sends a secondary request directly to theassigned connection, bypassing the load balancer. The service establishes a persistent link on the assigned connection and assigns a time-to-live (TTL), during which the service connects data requests to the databases. Upon expiration of the TTL, the service completes a next data request received, then notifies the client that the connection is no longer valid, thereby requiring a new connectionthrough the load balancer and rebalancing system traffic.

Description

Background technique [0001] The popularity of Web-based services and applications has created an ever-increasing demand for the network and database devices that support them. Users typically interact with a website through an application server, which connects to a database through a database server to retrieve the required data. The number of required application servers and corresponding connections to databases has been growing rapidly in accordance with demand. One way to expand capacity is horizontal scaling, adding machines in functional tiers, which is efficient but expensive. Therefore, some technologies (such as connection pooling and multiplexing) are also adopted to expand the business processing capability and connection usage in existing hardware. Furthermore, in high-traffic data systems with server farms, it is important to balance the load at each machine in order to distribute the load for system stability. To this end, load balancing distributes the conne...

AI Technical Summary

Problems solved by technology

However, load balancing also brings certain disadvantages

When running, the load balancer introduces latency, and when not running, the load balancer becomes a point of failure, which can result in no connections to the servers it is balancing, interrupting service to customers

Images