Live Migration of Massive Network Connections
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In datacenters, live migration of massive network connections, especially long-lived connections like HTTP streaming and pipelining, results in connection failures and increased latency when a node is taken down for maintenance or resource adjustments, leading to an overload of reconnection requests and degraded user experience.
Innovation Solution
Implement a system for live migration of connections between source and destination computers within a datacenter, maintaining active connections during migration by transferring connection state information and shifting traffic without interrupting service, initiated by load balancers, self-diagnostics, or administrator input, based on factors like availability and bandwidth.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a node is taken down for maintenance or resource adjustments, then resource utilization is optimized, but connection continuity deteriorates causing connection failures and latency
Solution Approach 1:
The patent establishes a connection migration mechanism that proactively transfers connections from the source node to destination nodes before the source node is taken down for maintenance. The load balancer monitors node status and initiates connection state information transfer in advance, ensuring connections are already migrated when the node goes offline, thus preventing connection failures while enabling resource optimization.
Solution Approach 2:
The patent introduces a load balancer as an intermediary component that manages connection migration between source and destination nodes. The load balancer maintains connection state information and routes traffic appropriately during the migration process, acting as a mediator that ensures seamless connection continuity while the underlying node infrastructure is reconfigured for optimal resource utilization.
2Reliability
If connections are migrated from source to destination computer, then service continuity is maintained, but system complexity increases due to connection state transfer and traffic shifting mechanisms
Solution Approach 1:
The load balancer is designed as a multi-functional component that simultaneously performs connection migration management, traffic routing, and connection state information storage. By consolidating these functions in a single component rather than requiring separate systems for each function, the patent maintains service continuity while limiting the increase in overall system complexity.
3Reliability
If live migration of massive numbers of connections is implemented, then user experience is improved by avoiding connection failures, but processing overhead increases during the migration process
Solution Approach 1:
The patent implements connection migration selectively based on monitored conditions such as node stability, maintenance requirements, and load balancing needs. Rather than continuously migrating all connections, the system performs partial migration only when and where necessary, reducing processing overhead while still improving user experience for the connections that are migrated.
Data Source
AI summary
A massive number of long lived connections is migrated between a source and a destination computer. Connection state information concerning each request being processed on each connection is transferred from the source to the destination computer. The source continues to respond to requests on a given connection while transferring corresponding state information. Once state information for a specific connection has been transferred, the connection is switched from the source to the destination. Connections are kept active during the shifting. While shifting traffic on a specific connection, two versions of the connection can be open simultaneously, one to the source and the other to the destination. Traffic on the connection is routed to the source computer until the shift has been completed, after which the connection on the source computer is closed, and traffic is routed to the destination.