Dynamic Connection Spillover for Virtual Servers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing network appliances struggle to dynamically adjust connection capacity in response to service failures, leading to reduced service availability when one or more services fail, as they rely on static threshold settings that do not account for service availability.
Innovation Solution
A method and system that dynamically determine and adjust the maximum connection threshold for a virtual server based on the status of its managed services, switching transport layer connection requests from an overloaded virtual server to another when a service becomes unavailable, thereby redistributing the connection capacity among available services.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a static connection capacity threshold is assigned to a virtual server, then the load balancing is simple to implement, but the system cannot compensate for service failures and service availability is reduced
Solution Approach 1:
The patent applies dynamics by transitioning from a static connection capacity threshold to a dynamic threshold that automatically adjusts based on service availability. The system continuously monitors service status and recalculates the maximum connection threshold for each virtual server according to the formula: new threshold = sum of connection capacities for available services only. This dynamic adjustment ensures that when services fail, the virtual server's capacity is automatically reduced, preventing overload and maintaining reliable service delivery.
Solution Approach 2:
The patent implements feedback mechanisms through service monitoring components that continuously track service status and provide this information back to the load balancing system. This feedback loop enables the system to detect service failures and automatically adjust virtual server connection thresholds in response, creating a closed-loop control system that maintains service availability while managing complexity through automation.
2Productivity
If the connection capacity threshold is increased to handle more connections, then the productivity is improved, but the system becomes vulnerable to overload when services fail
Solution Approach 1:
The patent applies parameter changes by dynamically modifying the connection capacity threshold parameter based on service availability conditions. Instead of using a fixed high threshold that maximizes productivity but risks overload, the system adjusts the threshold parameter in real-time according to the formula that sums connection capacities only for available services. This allows the system to maintain high productivity when all services are operational while automatically reducing capacity to prevent overload when services fail.
3Adaptability or versatility
If manual monitoring and adjustment of connection thresholds is performed, then the system can adapt to service failures, but the ease of operation is reduced
Solution Approach 1:
The patent implements self-service through automated service monitoring and threshold adjustment mechanisms. The system autonomously monitors service status, detects failures, calculates new connection thresholds using the defined formula, and applies adjustments without requiring manual intervention. This self-service capability provides full adaptability to service failures while maintaining operational simplicity, as the automation handles all complex decisions and adjustments transparently.
Data Source
AI summary
A method for an appliance to switch handling of transport layer connection requests from a first virtual server of the appliance managing a first plurality of services to a second virtual server of the appliance managing a second plurality of services upon exceeding, by the first virtual server, a maximum connection threshold determined dynamically from a status of the first plurality of services The appliance establishes a predetermined threshold identifying a maximum active transport layer connection capacity for the first virtual server that comprising a sum of a predetermined connection capacity for each of the plurality of services. The appliance determines via monitoring that the status of a service of the plurality of services indicates the service is not available and adjusts the predetermined threshold to comprise the sum of the predetermined connection capacity for each of the plurality of services having a status of available.