Proxy Service Continuity via Multi-Server Threshold Routing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
As the number of concurrent users increases, service servers providing content services like course registrations and concert reservations experience decreased response speed or service interruptions due to insufficient network bandwidth, leading to potential service failures.
Innovation Solution
A system comprising a target server, a queue management server, and a mirror server processes access requests, with threshold-based queue management and encryption key synchronization to ensure continuous service, where the target server handles requests until its capacity is exceeded, then the queue management server takes over, and finally the mirror server processes excess requests, maintaining service continuity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single server processes all access requests, then the system structure is simple, but the service is interrupted when the number of concurrent users exceeds the server's processing capacity
Solution Approach 1:
The system divides the server functionality into three separate servers: a target server that receives and verifies access requests, a queue management server that manages the queue when the target server is overloaded, and a mirror server that provides backup queue management. This segmentation ensures service continuity by distributing the processing load across multiple specialized servers, preventing service interruption when concurrent users exceed a single server's capacity.
2Reliability
If multiple servers process the queue, then service continuity is ensured, but the queue processing order may be disrupted
Solution Approach 1:
The target server acts as an intermediary that verifies all access requests using a checker before they are processed by the queue management server or mirror server. This verification step ensures that the processing order is determined by the target server's verification sequence rather than by which server (queue management or mirror) processes the request, thereby maintaining stable queue processing order across multiple servers.
Solution Approach 2:
The system changes the parameter of queue management from a single-server sequential process to a multi-server process with threshold-based routing. When the queue waiting amount exceeds a first threshold, the queue management server takes over; when it exceeds a second threshold, the mirror server becomes involved. This parameter-based routing maintains processing order stability while ensuring service continuity through multiple servers.
3Device complexity
If the target server processes the queue until capacity is exceeded, then simple queue management is maintained, but the response speed decreases when concurrent users increase
Solution Approach 1:
The system dynamically adjusts which server processes the queue based on the current load conditions. The target server processes requests normally until the queue waiting amount exceeds a first threshold value, at which point the queue management server takes over. When the waiting amount exceeds a second threshold, the mirror server becomes involved. This dynamic allocation optimizes response speed by distributing load across servers with different processing capacities, while maintaining a relatively simple queue management mechanism through automated threshold-based routing.
Data Source
AI summary
Disclosed is a system for ensuring the continuity of a proxy-based service, and a method thereof. The system includes a target server that processes a queue of access requests received from a plurality of client devices and processes the queue until a first time point when the waiting amount of access request exceeds a predetermined first threshold, a queue management server that processes the queue from the first time point until a second time point when the waiting amount exceeds a predetermined second threshold, and a mirror server that processes the queue from the second time point.