Routing Agents with Shared Rate Limits for Server Overload Prevention
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional routing systems face overload events during traffic bursts due to independent rate limiting by multiple routing agents, leading to suboptimal server utilization or overload, as each agent is unaware of the others' load and sets individual maximum rate limits independently.
Innovation Solution
Implementing a system where routing agents share current traffic loads and adjust their individual maximum rate limits in real-time based on a shared maximum rate limit, using the Diameter Overload Information Conveyance (DOIC) protocol, to prevent server overload during traffic bursts while optimizing server usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If each routing agent sets individual maximum rate limits independently, then each agent can control its own traffic load, but the server may still experience overload during traffic bursts because the total load from multiple agents exceeds the server capacity
Solution Approach 1:
The patent merges the rate limit control of multiple routing agents into a shared maximum rate limit for the server. Instead of each agent independently setting its own rate limit, all agents collectively share a single rate limit that represents the server's total capacity. This is achieved through load data sharing between agents, where each agent monitors the total load presented to the server and adjusts its own rate limit accordingly to ensure the sum of all agents' loads does not exceed the shared maximum rate limit, thereby preventing server overload.
Solution Approach 2:
The patent implements feedback mechanisms where routing agents continuously monitor and share load data with each other. Each agent receives load data from other agents servicing the same server and uses this feedback to dynamically adjust its own rate limit. This feedback loop ensures that when one agent increases its load, other agents automatically reduce their loads to compensate, maintaining the total load within the server's capacity and preventing overload conditions.
2Reliability
If routing agents share current traffic loads and dynamically adjust rate limits, then server overload is prevented, but the system complexity increases due to inter-agent communication and coordination
Solution Approach 1:
The patent makes each routing agent multi-functional by enabling them to perform both their primary function of routing traffic and the additional function of monitoring and sharing load data with other agents. Each agent is equipped with the capability to send and receive load data, calculate its own rate limit based on shared information, and dynamically adjust its traffic presentation. This universality reduces the need for separate dedicated coordination infrastructure, as the agents themselves perform the coordination functions.
Solution Approach 2:
The patent enables routing agents to self-adjust their rate limits based on shared load data without requiring centralized control or manual intervention. Each agent autonomously calculates its appropriate rate limit by considering the total server capacity and the loads presented by other agents. This self-service approach allows the system to maintain reliability through automatic adaptation while minimizing the complexity of external coordination mechanisms.
Data Source
AI summary
A system including multiple routing agents associated with a server. The routing agents may be configured to share current load data associated with the server. In some cases, the routing agents may also maintain a global maximum rate limit associated with each server of network resource. The global maximum rate limit may be shared between the routing agents to allow the routing agents may provide improve load balancing and prevent overload events on the server during traffic bursts.