Hierarchical Rate Limiting for Bandwidth Allocation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Service providers face challenges in managing traffic congestion and ensuring quality of service for real-time applications like VoIP and IPTV, as traditional rate limiting methods do not effectively differentiate between various Layer 4 protocols and fail to allocate unused bandwidth to lower priority traffic classes.
Innovation Solution
Implementing a hierarchical rate limiting system using multiple rate buckets associated with network interface ports, where each bucket monitors specific traffic parameters and adjusts packet thresholds to route excess packets to subsequent buckets, allowing for intelligent allocation of bandwidth across different service classes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional rate limiting is used to manage aggregate bandwidth, then bandwidth consumption can be controlled, but real-time services cannot be prioritized and unused bandwidth cannot be allocated to lower priority traffic
Solution Approach 1:
The rate limiting mechanism is segmented into multiple hierarchical levels: a parent rate bucket for aggregate bandwidth control and child rate buckets for different service classes (real-time, priority, best-effort). This segmentation enables differentiated service handling while maintaining overall bandwidth management, resolving the contradiction between service adaptability and structural complexity.
Solution Approach 2:
The patent implements a nested rate bucket structure where child rate buckets are contained within the parent rate bucket hierarchy. Each service class has its own nested bucket that can utilize unused bandwidth from parent buckets, enabling adaptive service differentiation without requiring a completely separate control mechanism for each service type.
2Reliability
If a single rate bucket is used for port-level traffic control, then aggregate bandwidth can be limited, but traffic prioritization and quality of service for real-time applications cannot be ensured
Solution Approach 1:
The single rate bucket is segmented into multiple child rate buckets, each dedicated to specific service classes (e.g., real-time, priority, best-effort). This segmentation enables quality of service differentiation by allowing real-time services to have guaranteed bandwidth allocation while still maintaining overall port-level bandwidth control, thus improving reliability without requiring external complex mechanisms.
3Adaptability or versatility
If bandwidth is allocated to real-time services, then quality of service improves, but lower priority traffic cannot utilize unused bandwidth
Solution Approach 1:
The rate bucket hierarchy implements dynamic bandwidth allocation where child rate buckets can utilize unused bandwidth from parent buckets in real-time. When real-time services are not using their allocated bandwidth, lower priority traffic can dynamically access the unused capacity, providing both service differentiation and efficient bandwidth utilization without requiring static allocation schemes.
Data Source
AI summary
A system for regulating traffic in a computer network comprises a plurality of rate buckets associated with a network interface ingress port. The system includes at least two rate buckets, related hierarchically, assigned to a specific ingress port on a network equipment device. At least one traffic parameter is associated with each rate bucket. Each rate bucket monitors traffic based on individual user-defined traffic parameters. At least one packet threshold parameter is associated with each rate bucket. Packets exceeding a rate bucket's packet threshold parameter are sent to subsequent rate buckets within the hierarchy based on an aggregate information rate assigned to the port. Each hierarchical rate bucket assigned to a specific port evaluates each packet prior to discarding a packet.