Persistent Connection Rebalancing in Server Clusters

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing server cluster management systems face inefficiencies in rebalancing persistent connections when the connection handling capacity increases, leading to suboptimal workload distribution and underutilization of additional server capacity.

Innovation Solution

A computer-implemented method and system that actively monitor the total client connection capacity of a server cluster, calculate a target client connection capacity utilization, and terminate persistent connections on servers with excessive utilization, allowing new connections to be reassigned using a load balancing algorithm without transferring persistent connections between servers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If persistent connections are maintained on servers after capacity increases, then connection stability is improved, but server capacity utilization deteriorates

Engineering Contradiction:

Improveconnection stabilityVSAvoidcapacity utilization

Core Design Contradiction:

Stability of the object's compositionVSProductivity

Solution Approach 1:

The system proactively identifies servers with excessive connection capacity before overload occurs and pre-emptively terminates persistent connections on these servers. This preliminary action redistributes connections to underutilized servers, ensuring optimal capacity utilization while maintaining connection stability through controlled reassignment.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The load balancer continuously monitors server capacity utilization and connection distribution, using this feedback to dynamically adjust connection termination decisions. When servers become underutilized due to capacity increases, the feedback mechanism triggers rebalancing actions that terminate connections on overloaded servers and redirect them to available capacity, resolving the contradiction between stability and utilization.

Inventive Principle:

Principle #23Feedback

2Productivity

If persistent connections are actively migrated between servers, then load balancing is improved, but system complexity deteriorates

Engineering Contradiction:

Improveload balancingVSAvoidsystem complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts the connection management logic from the network balancer and places it at the server level. Each server independently monitors its own connection capacity and makes local decisions about terminating persistent connections, eliminating the need for complex centralized migration mechanisms while achieving effective load balancing.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

Servers autonomously manage their own persistent connections by monitoring their capacity utilization and independently deciding when to terminate connections to maintain optimal load distribution. This self-service approach eliminates the need for complex inter-server coordination and centralized control, significantly reducing system complexity while preserving load balancing effectiveness.

Inventive Principle:

Principle #25Self-service

3Adaptability or versatility

If connection capacity is increased in server cluster, then system capability is improved, but connection distribution deteriorates

Engineering Contradiction:

Improvesystem capabilityVSAvoidconnection distribution

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The system dynamically adjusts persistent connection distribution in response to capacity changes. When new servers or capacity are added to the cluster, the system continuously monitors connection distribution patterns and dynamically terminates connections on servers that become over-capacitized, automatically adapting to the new capacity landscape and maintaining optimal distribution without manual intervention.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS10250507B2Persistent connection rebalancing

Publication Date: 2019.04.02 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Disclosed is a computer-implemented method of rebalancing persistent client connections to a cluster of servers. The method comprises identifying an increase in a total client connection capacity of the cluster of servers with a network connection balancing component; and for each server in a selection of servers in the cluster of servers calculating a current client connection capacity utilization of the server from the number of persistent connections to the server and the current capacity of the server; comparing the current client connection capacity utilization with the target client connection capacity utilization; and terminating a selection of its persistent client connections by a server based on its current client connection capacity utilization exceeding the target client connection capacity utilization. Also disclosed are a computer program product and a computer system for utilizing the computer-implemented method.