Workload Balancing via Upstream Threshold Propagation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Traditional workload balancing methods in computing systems fail to achieve global balance as they do not consider the workload limits of other components, leading to overloading and inefficiency when one component becomes a bottleneck.

Innovation Solution

A method that determines a more accurate utilization rate for each component by considering the workload thresholds of both upstream and downstream components, allowing for global workload balancing by adjusting workload amounts based on these thresholds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional utilization rate calculation methods are used (workload amount / workload limit of single component), then the calculation is simple, but the workload balance is inaccurate and does not reflect global system bottlenecks

Engineering Contradiction:

Improveutilization rate accuracyVSAvoidcalculation complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary mechanism by calculating workload thresholds that propagate through the component hierarchy. Instead of directly comparing workload to static limits, the system uses upstream component thresholds as dynamic reference points, allowing accurate utilization measurement without complex real-time optimization algorithms.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary calculation of workload thresholds for all components based on their hierarchy relationships before actual workload allocation. This pre-computation of thresholds (stored in configuration data) enables simple runtime utilization calculations while maintaining global system awareness, avoiding complex real-time computations.

Inventive Principle:

Principle #10Preliminary action

2Productivity

If workload is allocated without considering upstream component limits, then allocation is fast and simple, but components may become overloaded and system performance degrades

Engineering Contradiction:

Improveworkload allocation efficiencyVSAvoidcomponent overload prevention

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The patent implements feedback by having downstream components check their workload against upstream component thresholds before accepting additional work. The utilization rate calculation provides continuous feedback about system-wide capacity constraints, allowing components to self-regulate and prevent overload without centralized control.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts effective workload limits based on the current state of upstream components. Rather than using fixed workload limits, each component's effective capacity is dynamically determined by the thresholds of its upstream dependencies, allowing the system to adapt to changing conditions while maintaining reliability.

Inventive Principle:

Principle #15Dynamics

3Productivity

If components operate independently without considering system-wide constraints, then each component can maximize its own utilization, but global workload balance is not achieved and bottlenecks form

Engineering Contradiction:

Improvecomponent utilizationVSAvoidglobal workload balance measurement

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The patent merges individual component utilization metrics into a unified global workload balance measurement. By calculating utilization rates that incorporate upstream component thresholds, the system combines local component states with global system constraints into a single metric that reflects both component-level and system-level performance.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent adds a new dimension to workload measurement by incorporating the hierarchical relationship between components. Instead of measuring utilization in a single dimension (workload / limit), the system measures utilization in multiple dimensions by considering the component's position in the hierarchy and the thresholds of its upstream dependencies, enabling global balance assessment.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11436058B2Workload balancing to achieve a global workload balance

Publication Date: 2022.09.06 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Embodiments of the present disclosure relate to a new approach for workload balancing in a system. A computer-implemented method comprises obtaining a configuration of a system, wherein the configuration includes a connection relationship between components in the system. The method further comprises determining a workload threshold of a given component in the components based on the configuration, wherein a workload threshold of an upstream component of the given component is associated with a workload limit of the upstream component and a workload limit of the given component. The method further comprises determining a utilization rate of the given component based at least partially on a workload amount of the given component, the workload threshold of the given component, and the workload threshold of the upstream component. Accordingly, a more accurate utilization rate of each component in a system can be determined by considering the bottleneck of other components in the system, and thus workloads of various components in the system can be balanced from the perspective of the overall system.