Native Load Balancing in Network Switches

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional load balancers in data centers often act as bottlenecks due to their software-based solutions, which slow down network traffic handling and limit scalability, especially as data centers transition from 1 Gbps to 10 Gbps servers, and require external appliances and significant resources.

Innovation Solution

Configuring a network switch as a native load balancer using programmable hardware, such as ASICs or FPGAs, to handle load balancing at the hardware level, eliminating the need for external appliances and reducing overhead by operating at lower OSI layers, and utilizing TCAM for high-speed searches and routing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If software-based load balancers are used, then load balancing functionality is provided, but network speed and scalability are reduced

Engineering Contradiction:
Improvenetwork speedVSAvoiddevice complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent replaces software-based load balancing with hardware-based load balancing implemented in the switch fabric. This substitution of mechanical/software system with a hardware system eliminates the performance bottleneck and achieves wire-speed load balancing without the overhead of software processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent merges the load balancing functionality with the network switch by implementing the load balancer natively within the switch fabric. This consolidation eliminates the need for separate external load balancer appliances and integrates load balancing directly into the switching path, achieving both speed and scalability.

Inventive Principle:
Principle #5Merging (Combining)

2Productivity

If external load balancer appliances are used, then load balancing is achieved, but rack-space, power, and cost increase

Engineering Contradiction:
Improveresource efficiencyVSAvoidrack-space
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent combines multiple functions (network switching and load balancing) into a single network switch device. This eliminates the need for separate external load balancer appliances, reducing rack-space requirements while maintaining full load balancing functionality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The network switch is designed to perform multiple functions including both network switching and load balancing. This multi-functionality allows the single device to replace what would traditionally require separate specialized appliances, optimizing resource utilization and reducing infrastructure requirements.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If hardware-based load balancing is implemented, then speed and scalability are improved, but device complexity increases

Engineering Contradiction:
ImprovescalabilityVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the load balancing functionality into distinct components including a load balancing engine, a content-addressable memory (CAM) table for session tracking, and integration with the switch fabric. This segmentation allows complex hardware-based load balancing to be implemented in a modular, manageable way that maintains scalability while organizing device complexity into functional units.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10749805B2Statistical collection in a network switch natively configured as a load balancer
Publication Date: 2020.08.18 CISCO TECHNOLOGY INC
  • US10749805B2 patent drawing
  • US10749805B2 patent drawing
  • US10749805B2 patent drawing

AI summary

In an example, there is disclosed a network apparatus for providing native load balancing within a switch or router, including a first network interface operable to communicatively couple to a first network; a plurality of second network interfaces operable to communicatively couple to a second network; one or more logic elements comprising a switching engine operable for providing network switching or routing; and one or more logic elements forming a load balancing engine operable for receiving incoming network traffic via the first network, the incoming traffic having a destination internet protocol address (IP) corresponding to a virtual IP (VIP) designated for load balancing; assigning the incoming traffic to a traffic bucket associated with the second network; and logging the assigning; wherein the switching engine and load balancing engine are configured to be provided on the same hardware as each other and as the first network interface and plurality of second network interface.