Load-Balanced Forwarding for Network Packet Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Networking devices face challenges in efficiently handling high workloads due to limitations such as heat generation and diagnostic traffic congestion, which can impact their ability to process and forward network packets sustainably.

Innovation Solution

Implementing load-balanced forwarding techniques across multiple forwarding routes for both received and generated network packets, using randomization and hashing methods to distribute traffic evenly and reserve bandwidth for received packets, while ensuring that packets from the same traffic flow follow the same route.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If networking devices send diagnostic and evaluative information to other locations for performance evaluation, then performance monitoring capability is improved, but available bandwidth for received traffic is reduced and congestion occurs on particular ports and paths

Engineering Contradiction:
Improveperformance monitoring capabilityVSAvoidavailable bandwidth for received traffic
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent separates diagnostic traffic into distinct groups and assigns them to different forwarding paths. By segmenting the diagnostic traffic flow and distributing it across multiple paths, the system maintains performance monitoring capability while preventing any single path from becoming congested, thus preserving bandwidth for received traffic.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces path selection as an additional dimension for traffic management. By evaluating multiple forwarding paths and selecting optimal routes based on current network conditions, the system can send diagnostic information without compromising the bandwidth availability for received traffic on any single path.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If networking devices handle high workloads at great speed, then processing performance is improved, but heat generation increases and physical limitations are exceeded

Engineering Contradiction:
Improveprocessing speedVSAvoidheat generation
Core Design Contradiction:
ProductivityVSTemperature

Solution Approach 1:

The patent implements dynamic path selection that adapts to changing network conditions. By continuously evaluating and selecting optimal forwarding paths, the system can maintain high processing speeds while distributing thermal load across different hardware components and time periods, preventing any single component from exceeding its thermal limits.

Inventive Principle:
Principle #15Dynamics

3Reliability

If diagnostic traffic is sent to another location for evaluation, then performance evaluation capability is improved, but congestion occurs on particular ports at the networking device and paths from the networking device

Engineering Contradiction:
Improveperformance evaluation capabilityVSAvoidnetwork flow smoothness
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent segments diagnostic traffic into multiple groups and distributes them across different forwarding paths. This segmentation prevents any single port or path from becoming congested with all diagnostic traffic, maintaining smooth network flow while preserving performance evaluation capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the routing parameters for diagnostic traffic by evaluating multiple paths and selecting optimal routes based on current network conditions. This dynamic parameter adjustment allows diagnostic traffic to be sent without causing congestion on particular ports or paths.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10454831B1Load-balanced forwarding of network packets generated by a networking device
Publication Date: 2019.10.22 AMAZON TECH INC
  • US10454831B1 patent drawing
  • US10454831B1 patent drawing
  • US10454831B1 patent drawing

AI summary

Forwarding of network packets generated by a networking device may be load-balanced. Network packets may be generated by a networking device, such as a packet processor, that also processes and forwards received network packets. Forwarding decisions for the generated network packets may be made according to a load balancing scheme among possible forwarding routes from the networking device. In at least some embodiments, a destination resolution pipeline for determining forwarding decisions for generated network packets may be implemented separate from a destination resolution pipeline for determining forwarding decisions for received network packets in order to determine different forwarding decisions for the generated network packets. The generated network packets may then be forwarded according to the determined forwarding decisions.