Non-random Flowlet Routing for Network Switch Load Balancing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current load balancing algorithms in data centers, such as FGAR and LetFlow, either result in high congestion or substantial packet reordering, which are undesirable for protocols like TCP and UDP, leading to disruptions and reduced throughput.

Innovation Solution

A network switch with a hybrid load balancing capability that identifies flowlets and directs them to a least congested path using a fine-grained adaptive routing approach, ensuring all packets within a flowlet follow the same path without further congestion inspection, thereby reducing congestion and reordering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If fine-grained adaptive routing (FGAR) is used to select least congested path for each packet, then network congestion is reduced, but packet reordering occurs substantially

Engineering Contradiction:
Improvenetwork throughputVSAvoidpacket delivery order
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The invention segments a network flow into multiple flowlets based on packet inter-arrival times. Each flowlet is a subsequance of packets that are transmitted within a threshold time interval. By treating each flowlet as an independent unit for path selection rather than individual packets, the system reduces packet reordering while still achieving load balancing across multiple paths.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If random path selection is used for flowlets, then packet reordering is minimized, but network congestion increases

Engineering Contradiction:
Improvepacket delivery orderVSAvoidnetwork throughput
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The invention implements feedback mechanisms where network switches monitor congestion conditions on different paths and use this information to make informed path selection decisions for flowlets. The system adjusts path selection based on real-time congestion feedback, avoiding purely random selection while preventing the packet reordering problems associated with per-packet routing changes.

Inventive Principle:
Principle #23Feedback

3Productivity

If path selection is changed for each packet, then load balancing is optimized, but protocol compatibility deteriorates

Engineering Contradiction:
Improveload balancing efficiencyVSAvoidprotocol compatibility
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The invention introduces dynamic flowlet timing thresholds that adapt to network conditions and flow characteristics. The system dynamically adjusts the inter-arrival time threshold that determines whether packets belong to the same flowlet, allowing flexible optimization of load balancing while maintaining packet order within each flowlet to ensure protocol compatibility.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11394649B2Non-random flowlet-based routing
Publication Date: 2022.07.19 INTEL CORP
  • US11394649B2 patent drawing
  • US11394649B2 patent drawing
  • US11394649B2 patent drawing

AI summary

There is disclosed in one example a network switch, including an ingress port and a plurality of egress ports to provide a plurality of paths for a packet; a switching circuit to provide network switching; circuitry to identify the start of a flowlet; circuitry to select a non-random path for the flowlet; circuitry to latch the selected path for the flowlet; and a load balancer to receive a packet, match the packet to the flowlet, and direct the packet to the selected path.