Dynamic Traffic Throttling via Edge Worker Queuing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems struggle to dynamically react to changing traffic conditions by throttling traffic effectively, leading to service degradation when site capacity is exceeded.
Innovation Solution
Implementing a content delivery network (CDN) with edge workers that direct client devices to a waiting room site during traffic throttling, managed by a core services protection (CSP) system that dynamically adjusts throttling rates based on datacenter performance metrics, such as CPU usage and network conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traffic throttling is implemented to protect datacenter capacity, then service degradation is reduced, but dynamic responsiveness to changing traffic conditions is insufficient
Solution Approach 1:
The patent implements dynamic traffic throttling where the throttling rate is continuously adjusted based on real-time datacenter performance metrics. The system transitions from static to dynamic control by monitoring CPU usage, memory utilization, and other performance indicators, then automatically modifying the throttling rate to match current load conditions, ensuring both service quality and adaptability
Solution Approach 2:
The system establishes a feedback loop where datacenter performance metrics are continuously monitored and fed back to the traffic throttling mechanism. This feedback enables the system to detect performance degradation and automatically adjust throttling rates in response to actual system state, creating a closed-loop control system that balances reliability and adaptability
2Reliability
If traffic throttling rate is increased to protect datacenter performance, then other sites are protected from overload, but client device access delay increases
Solution Approach 1:
The patent applies partial throttling by directing only a portion of client devices to waiting room sites based on the calculated throttling rate. Instead of completely blocking traffic or uniformly throttling all connections, the system selectively applies throttling to maintain datacenter performance while minimizing overall access delay through proportional traffic management
Solution Approach 2:
The system dynamically changes the throttling rate parameter based on datacenter performance metrics. By adjusting this key parameter in real-time, the system optimizes the balance between protecting datacenter performance and minimizing client access delay, allowing flexible adaptation to varying load conditions without fixed thresholds
3Ease of manufacture
If manual traffic throttling configuration is used, then implementation is simple, but responsiveness to changing traffic conditions is poor
Solution Approach 1:
The patent implements self-service automation where the traffic throttling system automatically monitors datacenter performance metrics, calculates appropriate throttling rates, and adjusts traffic flow without manual intervention. The system serves itself by embedding the control logic within the existing infrastructure, eliminating the need for external configuration while maintaining simplicity through automated decision-making
Data Source
AI summary
Disclosed are examples of systems, apparatuses, methods, and computer program products for dynamic traffic throttling. A server system can receive, via an edge worker associated with a content delivery network (CDN), a first set of requests to access a first site. The server system can determine that traffic to the first site is to be throttled. The server system can determine a throttling rate. The server system can transmit instructions to the edge worker, the instructions configured to cause the edge worker to direct at least a portion of a second set of requests to access the first site to a waiting room site prior to being directed to the first site, the direction of the at least the portion of the second set of requests to the waiting room site being subject to the throttling rate.