Network Traffic Burst Pacing via Software-Hardware Bucket Scheduling

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In modern server networks, large data bursts often exceed the bandwidth of the network path, causing unnecessary latency and data loss due to overrun buffering, which can be mitigated by pacing data packets to match the network's true data rate.

Innovation Solution

A method and system for pacing data packets using a software component that selects buckets with predetermined transmit times, populates data packet descriptors, and releases them to a hardware component for processing, ensuring packets are transmitted at a rate matching the network's capacity, thereby avoiding latency and data loss.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If large data bursts are transmitted at full server speed, then data transfer efficiency is improved, but network latency increases and buffer overrun occurs

Engineering Contradiction:

Improvedata transfer efficiencyVSAvoidnetwork latency

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent segments large data bursts into smaller packets and introduces pacing mechanisms that space out packet transmission. The software component divides the data stream and the hardware component enforces time intervals between packets, preventing buffer overrun while maintaining efficient data transfer. This segmentation resolves the contradiction by allowing high productivity through burst transmission while avoiding latency through controlled packet spacing.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements feedback mechanisms where the hardware component monitors network conditions and adjusts packet transmission timing accordingly. The system receives feedback about buffer status and network bandwidth, then modifies the pacing of data transmission to match actual network capacity. This feedback loop resolves the contradiction by dynamically adjusting transmission speed to prevent latency while maintaining high data transfer efficiency.

Inventive Principle:

Principle #23Feedback

2Productivity

If data packets are transmitted in large bursts, then throughput is improved, but data loss due to buffer overrun increases

Engineering Contradiction:

ImprovethroughputVSAvoiddata loss

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent applies preliminary action by pre-calculating and pre-scheduling packet transmission times. The software component creates a pacing schedule before data transmission begins, and the hardware component enforces this schedule in advance. This preliminary planning ensures that packets are transmitted at optimal intervals, preventing buffer overrun before it occurs while maintaining high throughput. The system proactively adjusts transmission timing based on predicted network conditions.

Inventive Principle:

Principle #10Preliminary action

3Loss of time

If packets are spaced in time to match network bandwidth, then latency is reduced, but transmission speed decreases

Engineering Contradiction:

ImprovelatencyVSAvoidtransmission speed

Core Design Contradiction:

Loss of timeVSSpeed

Solution Approach 1:

The patent implements dynamics by making the packet transmission schedule adaptive and adjustable. The hardware component can dynamically modify pacing intervals based on real-time network conditions, traffic patterns, and buffer availability. This dynamic adjustment allows the system to optimize between latency and transmission speed, resolving the contradiction by finding the optimal balance point that changes with network conditions. The system transitions from static to dynamic pacing, enabling flexible optimization of performance parameters.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS9270602B1Transmit rate pacing of large network traffic bursts to reduce jitter, buffer overrun, wasted bandwidth, and retransmissions

Publication Date: 2016.02.23 F5 NETWORKS INC

AI summary

A system, method and medium is disclosed which includes selecting, at a software component of a network traffic management device, a first bucket having a first predetermined transmit time. The disclosure includes populating one or more selected data packet descriptors associated with one or more corresponding data packets in the first bucket. The disclosure includes releasing the first bucket to a hardware component of the network traffic management device, wherein the hardware component processes the one or more data packet descriptors of the first bucket for the first predetermined transmit time.