Queue Management System for Starvation and Latency Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing traffic prioritization systems in data networks often lead to congestion and starvation of lower priority traffic, resulting in latency and potential failure of data delivery.
Innovation Solution
The system manages traffic by grouping arriving data transmissions into time windows (epochs) and processing them in a defined priority order, ensuring that all transactions within an epoch are completed before starting the next, thereby preventing starvation and latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traffic prioritization is implemented to maximize bandwidth efficiency, then high priority data transmission is improved, but low priority traffic experiences starvation and increased latency
Solution Approach 1:
The patent segments the queue into multiple priority levels (e.g., high priority and low priority queues) and processes them in alternating rounds. This segmentation ensures that high priority traffic receives preferential treatment while low priority traffic is periodically serviced, preventing complete starvation and maintaining delivery guarantees for all traffic types.
Solution Approach 2:
The patent implements periodic action by alternating between processing high priority and low priority queues in defined rounds. This periodic switching ensures that no single priority level monopolizes the bandwidth indefinitely, thereby preventing starvation while still maximizing overall bandwidth efficiency through prioritized processing.
2Speed
If high priority requests continuously displace lower priority traffic from the queue front, then high priority data transmission speed is improved, but low priority traffic experiences starvation
Solution Approach 1:
The patent segments the transmission process into distinct priority rounds, where high priority traffic is processed first in each round. This segmentation allows high priority traffic to achieve fast transmission speeds within its allocated time slots, while low priority traffic is systematically serviced in subsequent rounds, preventing unbounded latency accumulation.
Solution Approach 2:
The patent applies periodic action by implementing alternating rounds of high priority and low priority traffic processing. This periodic structure ensures that high priority traffic maintains fast transmission speeds during its processing windows, while low priority traffic experiences bounded latency due to regular periodic servicing rather than continuous displacement.
3Reliability
If traffic prioritization creates a blocking effect, then high priority data delivery is improved, but low priority traffic experiences complete failure of delivery
Solution Approach 1:
The patent segments the queue into multiple priority levels and processes them in alternating rounds, ensuring that high priority traffic receives guaranteed service in each round while low priority traffic is periodically serviced. This segmentation prevents complete blocking of low priority traffic while maintaining reliable delivery guarantees for high priority traffic.
Solution Approach 2:
The patent implements periodic action by alternating between high priority and low priority processing rounds. This periodic structure ensures that high priority traffic maintains reliable delivery guarantees through consistent preferential treatment, while low priority traffic achieves non-zero throughput through regular periodic servicing, preventing complete delivery failure.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A quality of service (QoS) management system and guarantee is presented. The QoS management system can be used for end to end data. More specifically, and without limitation, the invention relates to the management of traffic and priorities in a queue and relates to grouping transactions in a queue providing solutions to queue starvation and transmission latency.