Packet Processor Header Routing for Low Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In high-bandwidth packet processing devices, the latency is increased due to the need for the header processor to wait for the entire packet header to be stored in packet memory before processing can begin, especially for short packets where most of the data is the header, leading to inefficiencies and potential packet drops.

Innovation Solution

The packet processor is designed to route the header directly to the header processor while the payload is loaded into packet memory, allowing processing to start as soon as the header is received, and implementing mechanisms such as an Early Header interface and configurable logical header length to reduce latency, along with optimizing queue management and data retrieval to prevent under-run conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the header processor waits for the entire packet header to be stored in packet memory before processing, then data integrity is ensured, but packet processing latency increases

Engineering Contradiction:
Improvedata integrityVSAvoidpacket processing latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by enabling the header processor to begin processing the packet header as soon as it is received from the receive direct memory access block, without waiting for the entire packet to be stored in packet memory. This allows processing to start in advance, reducing latency while maintaining data integrity through controlled access mechanisms.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent segments the packet into header and payload portions, allowing the header to be processed independently and in parallel while the payload is being stored. This segmentation enables the header processor to work on the header portion separately, reducing overall processing latency without compromising data integrity.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If the header processor waits for the header to be stored in packet memory, then processing accuracy is maintained, but processing speed decreases

Engineering Contradiction:
Improveprocessing accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The header processor performs processing actions preliminarily, starting as soon as the header data is available from the receive direct memory access block, rather than waiting for complete storage in packet memory. This preliminary processing maintains accuracy through controlled data access while significantly improving processing speed.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If the packet processor processes short packets where most data is header, then throughput is improved, but latency increases due to waiting for header storage

Engineering Contradiction:
ImprovethroughputVSAvoidlatency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

For short packets where the header constitutes most of the data, the patent applies preliminary action by enabling the header processor to start processing immediately when the header is received, without waiting for complete storage in packet memory. This reduces latency significantly for short packets while maintaining high throughput.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial action by processing only the header portion of the packet in advance, which is sufficient for making processing decisions. For short packets where the header is most of the data, this partial processing approach achieves near-complete processing without waiting for the entire packet to be stored, reducing latency while maintaining throughput.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9736069B1Method for storing and retrieving packets in high bandwidth and low latency packet processing devices
Publication Date: 2017.08.15 MARVELL ASIA PTE LTD
  • US9736069B1 patent drawing
  • US9736069B1 patent drawing
  • US9736069B1 patent drawing

AI summary

A packet processor includes a header processor and a packet memory. A receive direct memory access block is configured to receive a packet with a header and a payload and to route the header to the header processor and to route the payload to the packet memory such that the header processor begins processing of the header while the payload is loaded into packet memory.