Dynamic Workload Balancing Across Multiple Server Clusters

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional workload balancing methods in clustered application server environments are ineffective when multiple clusters are deployed and operated in parallel, as they rely on static sizing and distribution of load, leading to suboptimal performance and resource utilization.

Innovation Solution

A method and system for dynamically allocating resources from a pool of servers among multiple clusters based on their relative workload, where a central instance monitors load and adjusts server instances by activation, deactivation, or instance sharing to optimize resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If static sizing and distribution of load is used in traditional workload balancing methods, then the system structure is simple and easy to implement, but the performance and resource utilization deteriorate when multiple clusters are deployed in parallel

Engineering Contradiction:
Improveease of implementationVSAvoidperformance and resource utilization
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The patent implements dynamic workload balancing by continuously monitoring the workload of multiple clusters and automatically adjusting server allocation in real-time based on current conditions, transforming the static allocation model into a dynamic one that adapts to changing demands

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system establishes a feedback mechanism where the workload balancing device receives workload information from multiple clusters, processes this information, and sends control commands back to clusters to adjust server allocation, creating a closed-loop control system that continuously optimizes resource distribution

Inventive Principle:
Principle #23Feedback

2Productivity

If dynamic allocation of servers is implemented across multiple clusters, then resource utilization and performance improve, but the system complexity and difficulty of management increase

Engineering Contradiction:
Improveresource utilizationVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces a dedicated workload balancing device as an intermediary component that centralizes the complex logic of monitoring, calculating, and distributing workloads across multiple clusters, isolating the complexity from the cluster nodes themselves and simplifying their operation

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system divides the workload balancing functionality into distinct modular components: the workload balancing device that handles calculation and decision-making, the clusters that execute work, and the communication interface that coordinates between them, making the overall complex system manageable through functional segmentation

Inventive Principle:
Principle #1Segmentation

3Stability of the object's composition

If static server allocation is used within single clusters, then the configuration is simple and stable, but the response time and efficiency deteriorate when multiple clusters operate in parallel

Engineering Contradiction:
Improveconfiguration stabilityVSAvoidresponse time
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The patent transforms the static server allocation model into a dynamic one where server allocation automatically adjusts in real-time based on the workload conditions of multiple clusters, enabling the system to respond efficiently to changing demands while maintaining operational stability through controlled adaptation

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS7644137B2Workload balancing in environments with multiple clusters of application servers
Publication Date: 2010.01.05 SAP SE
  • US7644137B2 patent drawing
  • US7644137B2 patent drawing
  • US7644137B2 patent drawing

AI summary

Methods and apparatus, including computer program products, for workload balancing in environments with multiple clusters of servers. A process for sharing resources from a pool of servers among a first cluster of servers and a second cluster of servers includes determining a current workload of the first cluster and determining a current workload of the second cluster. The process calculates a combined workload of the first and second clusters, and allocates a first number of servers from the pool to the first cluster, the first number equal to a product of a total number of servers in the pool and the first server's workload divided by the combined workload.