Distributed Traffic Limiting via Dynamic Quota Allocation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing traffic limiting methods in distributed systems face issues with centralized decision-making delays and inaccurate load balancing, leading to suboptimal performance and resource utilization.
Innovation Solution
A method where distributed nodes autonomously determine traffic limitations by sending service volumes to a central node, which allocates decision quotas based on real-time data, allowing nodes to adjust their traffic handling accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If centralized traffic limiting is used, then traffic control decisions are made centrally, but decision latency increases and real-time accuracy deteriorates
Solution Approach 1:
The patent segments the centralized traffic control function into distributed components. Each node in the distributed system independently executes traffic control decisions based on locally received quotas, eliminating the need for real-time centralized decision-making while maintaining overall system coordination through periodic quota updates from the gateway node.
Solution Approach 2:
The gateway node performs preliminary traffic control calculations by determining quotas for each distributed node based on current system state and service volume predictions. These pre-calculated quotas are then distributed to nodes in advance, enabling nodes to make immediate local decisions without real-time centralized intervention.
2Speed
If average/weight-based distribution is used, then decision making is fast, but load balancing accuracy deteriorates under unbalanced conditions
Solution Approach 1:
The patent implements dynamic quota allocation where the gateway node continuously adjusts the service volume quotas assigned to each distributed node based on real-time system state and predicted service volumes. This dynamic adjustment enables accurate load balancing that adapts to changing conditions while nodes maintain fast local decision-making capabilities.
Solution Approach 2:
The system establishes a feedback loop where distributed nodes report their service volumes and system state to the gateway node, which then recalculates and redistributes quotas accordingly. This feedback mechanism ensures that load balancing accuracy is maintained under unbalanced conditions while preserving fast local decision execution.
3Ease of manufacture
If fixed service volume allocation is used, then implementation is simple, but resource utilization deteriorates when load is unbalanced
Solution Approach 1:
The patent changes the allocation parameter from fixed service volumes to dynamic quotas that are periodically adjusted by the gateway node. The gateway calculates optimal quotas based on current system state and predicted service volumes, allowing the system to maintain implementation simplicity through automated calculations while significantly improving resource utilization under unbalanced load conditions.
Data Source
AI summary
The present disclosure provides a method and system of limiting traffic. The method includes: sending, by a distributed node, a service volume in a current preset time period to a central node according to a fixed period; determining, by the central node, a decision quota of the distributed node based on the received service volume, and sending the decision quota to the distributed node; receiving, by the distributed node, the decision quota sent by the central node; and determining, by the distributed node based on the latest received decision quota after receiving an access request, whether traffic limitation needs to be performed for the access request. The traffic limitation decision of the present application is made by the distributed node autonomously, the decision path is short, and fast and accurate decision making is achieved.