Accelerated NIC Load Balancing for Overlay Encapsulated Traffic

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing load balancing methods for network traffic in data centers are ineffective for overlay-encapsulated traffic, as they rely on visible packet headers which are obscured by encapsulation, limiting the scalability of virtualization platforms and impairing performance.

Innovation Solution

Implementing a system with accelerated Network Interface Cards (NICs) that hash packet contents, select uplinks based on hash values, and encapsulate packets with the selected NIC's MAC address in the outer header, enabling effective load balancing of overlay-encapsulated traffic without requiring switch configuration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional load balancing methods are used for network traffic, then load balancing works for standard packets with visible headers, but load balancing fails for overlay-encapsulated traffic because the original packet headers are obscured by encapsulation

Engineering Contradiction:
Improveload balancing effectivenessVSAvoidcompatibility with overlay networks
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent introduces an intermediary mechanism (hashing algorithm) that operates on the encapsulated overlay packets to extract load balancing information. Instead of relying on the original inner packet headers which are obscured, the system applies a hashing function to the outer encapsulated packet headers to generate hash values that determine uplink selection. This intermediary approach enables load balancing to function effectively with overlay-encapsulated traffic while maintaining compatibility with the encapsulation mechanism.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the number of overlay networks increases to expand virtualization capabilities, then network virtualization scalability improves, but the virtualization platform's processing load increases beyond its capabilities

Engineering Contradiction:
Improvenetwork virtualization scalabilityVSAvoidvirtualization platform processing capacity
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent extracts the load balancing decision-making process from the virtualization platform's main processing path. By implementing hashing-based uplink selection at the network interface level (rather than requiring full platform processing), the system removes the computational burden of load balancing decisions from the virtualization platform. This extraction enables the platform to scale to more overlay networks without proportionally increasing processing requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If server-side NICs are teamed with static binding or port channels for load balancing, then load balancing is achieved for standard traffic, but configuration complexity increases and effectiveness is lost for overlay traffic

Engineering Contradiction:
Improveload balancing performanceVSAvoidconfiguration complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a self-service load balancing mechanism where the network interface cards automatically perform hashing-based uplink selection without requiring external configuration. The system uses the inherent properties of the overlay packet headers and applies hashing algorithms autonomously to determine uplink assignment. This eliminates the need for complex static binding configurations or port channel setups on both switches and servers, reducing configuration complexity while maintaining load balancing effectiveness for overlay traffic.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9172557B2Load balancing overlay network traffic using a teamed set of network interface cards
Publication Date: 2015.10.27 KYNDRYL INC
  • US9172557B2 patent drawing
  • US9172557B2 patent drawing
  • US9172557B2 patent drawing

AI summary

A system includes a server including: logic adapted for receiving traffic from a virtual machine (VM), the traffic including at least one packet, logic adapted for hashing at least a portion of the at least one packet according to a hashing algorithm to obtain a hash value, and logic adapted for selecting an uplink based on the hash value; at least one accelerated network interface card (NIC), each accelerated NIC including: network ports including multiple Peripheral Component Interconnect express (PCIe) ports adapted for communicating with the server and a network, each network port including an uplink, logic adapted for encapsulating the at least one packet into an overlay-encapsulated packet, logic adapted for storing a media access control (MAC) address corresponding to the selected uplink as a source MAC (SMAC) address in an outer header of the overlay-encapsulated packet, and logic adapted for sending the overlay-encapsulated packet via the selected uplink.