Software Load Balancer Direct Server Return Optimization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Distributed computing systems face performance bottlenecks and scalability issues due to ineffective workload management across multiple computing resources, particularly with conventional load balancers and ADCs that rely on expensive hardware and limited capabilities like Direct Server Return (DSR) optimization.

Innovation Solution

Implementing a method where a source device receives client requests, determines a target device to respond, modifies packet addresses, and transmits the request to the target device, allowing direct responses without traversing the source device, utilizing a switching layer to adjust packet destinations based on reserved portions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional load balancers and ADCs are used to manage workloads across multiple computing devices, then workload distribution is achieved, but system performance bottlenecks and scalability problems occur

Engineering Contradiction:

Improveworkload management efficiencyVSAvoidsystem complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent extracts the load balancing functionality from traditional hardware-based ADCs and implements it as software running on general-purpose computing devices. This separates the traffic management function from specialized hardware, allowing the system to scale more effectively while reducing complexity.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The invention makes standard computing devices perform multiple functions - they can act as both application servers and load balancers. This multi-functionality eliminates the need for separate specialized hardware, improving productivity while reducing device complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Ease of manufacture

If Direct Server Return (DSR) optimization is used to reduce traffic through the load balancer, then hardware costs are reduced, but the load balancer cannot detect when connections are closed and port address translations are not allowed

Engineering Contradiction:

Improvehardware costVSAvoidconnection management capability

Core Design Contradiction:

Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent introduces a software-based intermediary that operates at the application layer to monitor connection states and manage traffic. This software mediator can detect connection closures and perform port address translations while allowing DSR optimization to reduce hardware costs.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The invention changes the operational parameters of DSR by implementing it at the software layer rather than hardware layer. This allows the system to maintain the cost-reducing benefits of DSR while gaining enhanced adaptability through software-based connection management and port address translation capabilities.

Inventive Principle:

Principle #35Parameter changes

3Reliability

If specialized hardware is used for load balancers and ADCs, then traffic management capability is improved, but system costs increase

Engineering Contradiction:

Improvetraffic management capabilityVSAvoidsystem cost

Core Design Contradiction:

ReliabilityVSEase of manufacture

Solution Approach 1:

The patent replaces expensive, specialized hardware load balancers with software implementations on commodity computing devices. This substitution of cheap, general-purpose hardware with software functionality maintains traffic management capability while significantly reducing system costs.

Inventive Principle:

Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The invention substitutes the mechanical/hardware-based traffic management system with a software-based system. This replacement maintains or improves traffic management capability through more flexible software algorithms while eliminating the need for expensive specialized hardware.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11316786B2Systems and methods for directly responding to distributed network traffic

Publication Date: 2022.04.26 VERIZON PATENT & LICENSING INC

AI summary

Systems and methods are disclosed for directly responding to distributed network traffic received from a plurality of client devices. One method includes receiving, at a source device, client requests including a packet having a reserved portion, a source portion, and a destination portion; determining, for each client request, a target device from a plurality of target devices to respond to the client request; modifying, for each client request by the source device, the destination portion of the packet to an address of target device; modifying, for each client request by a switching layer prior to the target device receiving the modified client request, the destination portion; and responding directly to each client request by the target device without traversing the source device.