Load Balancer Heartbeats for Seamless Server Capacity Contraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Networking environments face challenges in dynamically adjusting capacity to meet varying demands, with existing cloud protocols struggling to efficiently route client devices to available capacity and gracefully manage server shutdowns, leading to increased latency and connection issues.
Innovation Solution
Implementing a networking system with load balancers that report activity regularly, combine connection handshake with key exchange, and integrate routing and load balancing to reduce latency and efficiently manage server availability, using heartbeat signals to notify clients of server inactivity and facilitate seamless transitions to alternative servers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If servers shut down without warning, then infrastructure can be quickly contracted, but client timeout increases and connections must be restarted
Solution Approach 1:
The load balancer performs preliminary action by actively tracking server status through heartbeat signals and proactively notifying clients before the server actually shuts down. This allows clients to prepare for connection changes in advance, reducing timeout duration and avoiding unnecessary connection restarts while still enabling quick infrastructure contraction.
2Loss of time
If load balancer combines routing and load balancing into one host, then network hops are reduced, but device complexity increases
Solution Approach 1:
The patent applies merging by combining routing and load balancing functions into a single host. This integration eliminates additional network hops and reduces connection latency by having the load balancer directly perform routing decisions without requiring separate routing infrastructure, while the complexity is managed through unified software implementation.
3Loss of time
If connection handshake is combined with key exchange, then TLS data exchanges are removed, but protocol complexity changes
Solution Approach 1:
The patent merges the connection handshake process with the key exchange process into a single integrated operation. This combination eliminates redundant TLS data exchanges that would otherwise occur after the connection handshake, reducing connection establishment time while the protocol complexity is managed through unified cryptographic operations.
Data Source
AI summary
Systems, apparatuses, and methods are described for adjusting capacity in a networking environment. A networking system comprising clients, servers, load balancers, and/or other devices may expand and contract network capacity as needed. When expanding network capacity, load balancers may instruct client devices to connect to servers that are part of the expanded network. When network capacity is reduced, a server and/or a load balancer my instruct client devices to close a connection with a first server and establish a connection with a second server. Client devices may seamlessly begin using the connection with a second server without having to wait for a connection timeout with the first server.