Multi-threaded Traffic Shaper Microburst Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing QoS solutions for traffic shaping in network processors face performance penalties due to inefficient processing times, particularly in managing multi-threaded traffic queues.
Innovation Solution
A computing device with a set of instructions that divides a burst period into microbursts based on the count of worker threads and shaper bandwidth, allowing simultaneous enqueue and dequeue operations on multiple queues without a locking mechanism.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a locking mechanism is used to manage multi-threaded traffic queues, then thread safety is improved, but processing time efficiency deteriorates
Solution Approach 1:
The patent divides the single shaper queue into multiple sub-queues, with each sub-queue managed by a dedicated worker thread. This segmentation eliminates the need for locking mechanisms because each thread operates independently on its own sub-queue, resolving the contradiction between thread safety and processing time efficiency.
Solution Approach 2:
Each worker thread independently manages its assigned sub-queue without requiring coordination or locking with other threads. The threads self-service their respective queues, performing enqueue and dequeue operations autonomously, which eliminates locking overhead and improves processing time while maintaining thread safety.
2Productivity
If multiple threads perform enqueue/dequeue operations simultaneously, then productivity is improved, but system complexity increases
Solution Approach 1:
The shaper queue is segmented into multiple sub-queues, each handled by a dedicated worker thread. This segmentation enables simultaneous enqueue/dequeue operations across multiple threads (improving productivity) while simplifying the system architecture by eliminating the need for complex locking mechanisms (reducing system complexity).
Solution Approach 2:
Multiple independent worker threads are combined to handle different sub-queues of the same shaper queue. This merging of parallel processing capabilities improves productivity while the uniform structure of sub-queues maintains system simplicity.
Data Source
AI summary
Embodiments of a computing device for traffic shaping are disclosed. In an embodiment, the computing device includes one or more processor(s) coupled to a memory. The memory includes a set of instructions which when executed causes the one or more processor(s) to divide a burst period associated with a shaper queue into a plurality of microbursts based at least on a count of worker threads corresponding to a plurality of queues and a shaper bandwidth. The plurality of queues constitutes the shaper queue.