Dynamic Server Load Distribution via Weighted Subset Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current server load distribution mechanisms face bottlenecks and inefficiencies, particularly with DNS-based load balancing, which limits scalability due to size constraints and unequal resource utilization among servers, leading to potential overloading or underutilization.

Innovation Solution

A computer-implemented method that assigns weight factors to servers based on their performance profiles and adjusts these weights dynamically to ensure a desired load distribution, using a subset of servers for each client request, allowing for flexible distribution of workloads and resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If DNS-based load balancing is used to distribute requests among multiple servers, then load distribution is achieved, but scalability is limited due to the 512-byte response size constraint

Engineering Contradiction:
Improveload distribution capabilityVSAvoidscalability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent segments the server list into multiple groups and uses multiple DNS queries to retrieve servers. Instead of returning all servers in a single DNS response (which is limited to 512 bytes), the system divides the large server list into manageable segments and retrieves them through multiple smaller queries, effectively overcoming the DNS response size limitation while maintaining scalability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension to load balancing by using server groups and multiple retrieval stages. Rather than a single flat list of servers, the system organizes servers into hierarchical groups and uses multi-stage DNS queries to access them, enabling scalable server management beyond the traditional single-level DNS response constraint.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Quantity of substance

If all servers are returned in a single DNS response, then complete server list is provided, but the response size exceeds the 512-byte DNS limitation

Engineering Contradiction:
Improvenumber of servers returnedVSAvoidDNS response management
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent segments the complete server list into multiple groups and uses multiple DNS queries to retrieve them. This segmentation allows the system to provide a comprehensive server list while keeping each individual DNS response within the 512-byte limit, effectively managing large quantities of server information without exceeding DNS constraints.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary organization of servers into groups before the actual DNS queries are executed. By pre-segmenting the server list and preparing the query structure in advance, the system can efficiently retrieve large numbers of servers through multiple controlled queries rather than attempting a single oversized response.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If weight factors are not adjusted for subset selection, then simple server selection is maintained, but load distribution does not match the desired profile

Engineering Contradiction:
Improveserver selection simplicityVSAvoidload distribution accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent implements a feedback mechanism where the system tracks which servers were selected in previous random subsets and adjusts weight factors accordingly. This feedback loop ensures that servers with higher weights are more likely to be selected in subsequent queries, gradually converging the actual load distribution toward the desired profile while maintaining the simplicity of random selection.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent dynamically changes the weight factors as a function of the desired load distribution profile and the subset size. By adjusting these parameters based on the actual subset selected, the system maintains operational simplicity while achieving precise load distribution control through mathematical adjustment of selection probabilities.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10757176B1Systems, methods, devices and arrangements for server load distribution
Publication Date: 2020.08.25 8X8 INC
  • US10757176B1 patent drawing
  • US10757176B1 patent drawing
  • US10757176B1 patent drawing

AI summary

A variety of methods, systems, devices and arrangements are implemented for controlling server load-distributions. According to one such computer-implemented method, a desired server load-distribution is assigned for a plurality of computer servers that collectively provide services to computer clients. In response to a computer client request for service, a subset of computer servers is selected from the plurality of computer servers. Weight factors for servers of the selected subset of servers are determined as a function of the overall server load-distribution-profile and the selected subset.