Burst Absorption Buffering Network Packet Metadata

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Networking devices face challenges in efficiently processing high volumes of network packets due to physical limitations such as heat generation and resource constraints, leading to potential drops in packet processing capacity and increased latency.

Innovation Solution

Implementing burst absorption techniques that buffer metadata instead of entire packets, allowing packet data to be stored at the incoming rate while processing metadata at the packet processing rate, thereby handling bursts without requiring all packets to be buffered and maintaining pipeline efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If networking devices buffer entire packets to handle bursts, then packet loss is reduced, but memory usage and latency increase significantly

Engineering Contradiction:
Improvepacket loss preventionVSAvoidmemory usage
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent segments the packet into two parts: metadata (header information) and payload (data content). Only the metadata is buffered in the burst absorption buffer, while the payload is forwarded directly to the egress queue. This segmentation allows the system to track and manage packets through their metadata without storing the entire packet content, significantly reducing memory requirements while maintaining packet integrity and preventing loss.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the essential metadata from each packet and places it in the burst absorption buffer, leaving the payload to be handled separately. This extraction principle allows the system to maintain packet ordering and tracking information without the memory overhead of storing complete packets, resolving the contradiction between reliability and memory usage.

Inventive Principle:
Principle #2Taking out (Extraction)

2Productivity

If networking devices increase processing capacity to handle high workloads, then packet processing speed improves, but power consumption and heat generation increase

Engineering Contradiction:
Improvepacket processing capacityVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by buffering only the metadata portion of packets rather than complete packets. The burst absorption buffer holds minimal information needed for packet tracking and ordering, allowing the system to handle traffic bursts without the excessive resource consumption that would result from buffering entire packets. This partial buffering approach maintains processing capacity while reducing power consumption.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If networking devices buffer more packets to prevent loss during bursts, then reliability improves, but processing latency increases

Engineering Contradiction:
Improvepacket delivery reliabilityVSAvoidprocessing latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

By segmenting packets into metadata and payload, the system buffers only the small metadata portion in the burst absorption buffer while the larger payload is quickly forwarded. This segmentation minimizes the time packets spend in buffering, reducing latency while maintaining reliability through metadata tracking that ensures no packets are lost during bursts.

Inventive Principle:
Principle #1Segmentation

4Productivity

If networking devices allocate more resources to increase processing capacity, then performance improves, but device complexity and cost increase

Engineering Contradiction:
Improvepacket processing performanceVSAvoidresource allocation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent simplifies resource allocation by segmenting packet handling into two distinct paths: metadata processing through the burst absorption buffer and payload forwarding through direct queues. This segmentation allows the system to allocate minimal buffering resources while maintaining high processing performance, avoiding the complexity of managing large unified buffers for entire packets.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9961022B1Burst absorption for processing network packets
Publication Date: 2018.05.01 AMAZON TECH INC
  • US9961022B1 patent drawing
  • US9961022B1 patent drawing
  • US9961022B1 patent drawing

AI summary

Packet processors may implement burst absorption for processing network packets. Network packets may be processed at a packet processor according to a packet processing rate. For network packets that do not exceed the packet processing rate, processing of the network packets commences without an intervening buffer to store packet metadata. For network packets that exceed the packet processing rate, control metadata may be stored in a buffer at the excessive processing rate separate from packet data until removed from the buffer for processing according to the packet processing rate. In some embodiments, pipeline bubbles may be inserted by delaying the removal of packet metadata from the burst absorption buffer in order to start a pipeline bubble through forwarding stages of a packet processor.