Server Overload Management via Priority Buffer Tasks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Server overloads lead to user frustration and financial losses due to failed transactions and slowdowns, as existing load balancing methods often result in users being presented with error messages, causing them to abandon requests.
Innovation Solution
A method that determines server overload, assigns priority to requests, and presents buffer tasks to users based on priority levels, allowing higher-priority requests to be processed first while keeping lower-priority users engaged with tasks that do not compete for server resources, thereby reducing frustration and retention loss.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If load balancing is implemented to distribute traffic amongst several servers, then server resource utilization is improved, but user frustration increases due to error messages and request failures
Solution Approach 1:
The patent introduces buffer tasks as an intermediary mechanism between the user and the overloaded server. When a server is detected to be overloaded, instead of immediately presenting an error message, the system assigns buffer tasks to users. These tasks act as a mediator that occupies user time while the server recovers, transforming the direct negative interaction (error message) into a softer interaction (optional task completion).
Solution Approach 2:
The system performs preliminary actions by assigning buffer tasks to users before the server is fully recovered. This allows the server to be pre-loaded with recovery operations while users are engaged in buffer tasks, ensuring that when the server becomes available, it can immediately process requests without further delays or error messages.
2Device complexity
If server overload is handled by presenting error messages to users, then server resource allocation is simplified, but request completion rate decreases due to user abandonment
Solution Approach 1:
Buffer tasks serve as an intermediary layer that improves request completion rates without significantly increasing server complexity. The tasks are managed by the existing server infrastructure, leveraging current resources rather than requiring entirely new systems. This intermediary approach bridges the gap between simplified server management and improved request completion.
3Adaptability or versatility
If all requests are treated equally in load balancing, then system fairness is improved, but processing efficiency decreases due to lack of priority differentiation
Solution Approach 1:
The patent applies local quality by treating different requests differently based on their characteristics. Instead of uniform treatment, the system assigns buffer tasks selectively based on request priority, user preferences, and server conditions. High-priority requests receive preferential treatment with fewer or shorter buffer tasks, while low-priority requests receive more extensive tasks, optimizing processing efficiency without sacrificing fairness.
Data Source
AI summary
A system can determine if a server is overloaded and unable to process a request selected for transmission by a user. If the server is unable to process the request, the system can present buffer tasks for the user to complete while the system repeatedly pings the server, checking to see if the server is still unable to process the request. If the system detects that the server is not overloaded or no longer is overloaded, the system sends the request. The system can determine a priority of the request and adjust buffer tasks based on the priority.