Influence-Based API Entry Control for Stable Service Response
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increase in concurrent users of service servers providing content services leads to traffic explosions, resulting in deteriorated response speed and potential service interruptions, necessitating efficient traffic control and entry management.
Innovation Solution
A system utilizing a traffic control server that calculates influence on metric information based on connection requests by API groups, outputs change information, and extracts a preset target entry allowed number to manage user terminals effectively, employing a processor to control service servers based on these metrics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the number of concurrent users is increased, then the service capacity is improved, but the response speed deteriorates and service interruptions occur
Solution Approach 1:
The patent segments users into different priority groups (first priority users and second priority users) based on their entry requests and influence metrics. This segmentation allows the system to differentiate traffic control strategies for different user groups, enabling high-priority users to maintain access while limiting lower-priority users during high load conditions, thus maintaining service reliability while supporting increased concurrent users.
Solution Approach 2:
The system dynamically changes the entry allowed number parameter based on calculated influence metrics and current system load. By adjusting this parameter in real-time according to user priority and system capacity, the system can accommodate more concurrent users when capacity allows while preventing service interruptions when load is high, effectively resolving the contradiction between quantity and reliability.
2Reliability
If traffic control is implemented to maintain service stability, then service reliability is improved, but the entry capability for user terminals deteriorates
Solution Approach 1:
The patent applies different traffic control qualities to different user groups. First priority users experience minimal restriction with higher entry allowed numbers, while second priority users face stricter control with lower entry allowed numbers. This local differentiation of control quality maintains service stability through targeted restriction rather than blanket limitations, preserving ease of operation for critical users while controlling overall traffic.
Solution Approach 2:
The system dynamically adjusts entry allowed numbers based on real-time influence calculations and system state. Rather than implementing static traffic control that uniformly restricts all users, the dynamic adjustment allows entry capability to adapt to current conditions, maintaining service stability while minimizing unnecessary restrictions on user access.
3Quantity of substance
If the entry allowed number is increased to accommodate more users, then the service coverage is improved, but the system load increases causing service interruptions
Solution Approach 1:
The system performs preliminary influence calculations and determines entry allowed numbers before users actually connect. By pre-calculating the impact of allowing additional users and comparing it against system capacity thresholds, the system can proactively set appropriate entry limits, preventing system overload before it occurs while still maximizing the number of users that can be accommodated.
Solution Approach 2:
The patent implements a feedback mechanism where the system continuously monitors the influence of connection requests on metric information and adjusts entry allowed numbers accordingly. This closed-loop control allows the system to learn from past performance and optimize the balance between accommodating users and preventing overload, improving service coverage while avoiding service interruptions.
Data Source
AI summary
The present disclosure is to calculate influence on metric information based on the number of connection requests by API group of the user terminals received from the service server through a communication module and the metric information, output change information of the metric information based on the number of connection requests by API group and the influence, extract a preset target entry allowed number by API group in connection with the change information of the metric information, and control the service server to perform a control of the user terminals based on the target entry allowed number by API group.