Server Connection Capacity Management via Dynamic Load Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current server management systems lack an automatic mechanism to handle overloading situations when multiple concurrent client connections exceed the server's capacity, leading to queued requests and resource consumption issues, especially in large-scale systems with varying request traffic rates across multiple connections.
Innovation Solution
A transaction processing server with a client-server connector, connection capacity controller, and server capacity monitor that dynamically adjusts the maximum permitted concurrent requests on client-server connections to prevent overload, allowing the server to recover when capacity is regained.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the server allows multiple concurrent client connections with high request rates, then the server's productivity and resource utilization are improved, but the server becomes vulnerable to overload when too much work arrives simultaneously
Solution Approach 1:
The patent implements dynamic adjustment of connection capacity limits based on real-time server load conditions. The system monitors server workload and automatically modifies the maximum permitted concurrent requests for client connections, transitioning from static pre-configured limits to adaptive dynamic control. This resolves the contradiction by allowing high throughput when capacity is available while automatically reducing capacity when overload is detected, maintaining reliability without sacrificing productivity.
Solution Approach 2:
The system establishes a feedback loop where the server continuously monitors its own load conditions and uses this information to adjust connection capacity limits. When the server detects overload conditions, it sends instructions to clients to reduce their request rates; when capacity is available, it allows increased rates. This closed-loop feedback mechanism enables the server to maintain optimal productivity while automatically protecting against overload, resolving the technical contradiction between throughput and reliability.
2Reliability
If the server pre-configures connection capacity limits to prevent overload, then server reliability is improved, but the capacity cannot adapt to varying traffic patterns and may cause unnecessary request rejections
Solution Approach 1:
The patent transforms static pre-configured capacity limits into dynamic adjustable parameters. Instead of setting fixed connection capacity limits during configuration, the system continuously monitors server load and automatically adjusts the maximum permitted concurrent requests in real-time. This dynamic approach maintains reliability by preventing overload while simultaneously improving adaptability to varying traffic patterns, as the capacity limits automatically scale with actual server capacity and demand conditions.
Solution Approach 2:
The system changes the operational parameters of connection capacity limits from fixed predetermined values to dynamically adjustable values based on server load conditions. The server monitors workload metrics and modifies the maximum permitted concurrent requests parameter accordingly, allowing the system to adapt to varying traffic patterns while maintaining overload protection. This parameter transformation resolves the contradiction between reliability and adaptability.
3Productivity
If the server queues excess work requests when at full capacity, then productivity is maintained by processing requests eventually, but system resources are consumed by queue management in the already-overloaded server
Solution Approach 1:
The system takes preliminary action by proactively monitoring server load conditions and adjusting connection capacity limits before overload occurs or when overload is first detected. Instead of allowing requests to queue up and consuming resources on queue management, the server preemptively reduces the maximum permitted concurrent requests for clients, preventing excess work from arriving. This resolves the contradiction by maintaining productivity through controlled request flow while avoiding the resource consumption associated with queue management.
Solution Approach 2:
The system extracts the queue management function from the overloaded server by implementing client-side rate limiting controlled by server instructions. Instead of the server maintaining and managing queues of excess requests, the server sends instructions to clients to reduce their request rates, effectively removing the queue management burden from the server. This resolves the contradiction by maintaining request processing continuity while eliminating the resource consumption of queue management in overloaded conditions.
Data Source
AI summary
Dynamic management of concurrent client connections to a server is achieved by a server, in that the server monitors its load state and when the server's maximum permitted number of concurrent requests has been exceeded it reduces the clients' maximum numbers of permitted concurrent requests until such time as the overloading situation no longer persists. In this way, the capacity of each of multiple connections can be controlled by the server individually or as a group, wherein the control is dynamic, so that the client-server connections do not have to be accurately configured in advance.