Cache Load Balancing in Virtual I/O Servers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Virtual Small Computer System Interfaces (VSCI) do not provide a load sharing mechanism between multiple Virtual Input/Output Servers (VIOS), leading to cache utilization imbalances that can result in performance bottlenecks and slowed virtual machine operations.

Innovation Solution

A system and method for monitoring cache utilization levels across multiple VIOS, identifying imbalances, and transferring logical storage units between them to redistribute workload and balance cache usage, thereby reducing imbalances and enhancing system performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple VIOS are used to handle larger workloads, then system capacity and flexibility are improved, but cache utilization imbalances occur leading to performance bottlenecks

Engineering Contradiction:
Improvesystem capacityVSAvoidperformance consistency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system continuously monitors cache utilization levels across multiple VIOS and uses this feedback to dynamically detect imbalances. When a VIOS reaches a high cache utilization threshold, the system responds by transferring logical storage units from that VIOS to others with lower utilization, thereby maintaining consistent performance across the distributed system.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The load balancing mechanism dynamically adjusts the distribution of logical storage units based on real-time cache utilization conditions. Rather than using a static allocation scheme, the system continuously adapts its configuration to balance cache loads across VIOS, preventing performance bottlenecks while maintaining high system capacity.

Inventive Principle:
Principle #15Dynamics

2Quantity of substance

If cache resources are increased in a single VIOS to handle larger workloads, then that VIOS can manage more load, but load sharing between multiple VIOS is not achieved

Engineering Contradiction:
Improvecache resourcesVSAvoidload sharing capability
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The system enables each VIOS to serve multiple functions: acting as both a standalone cache resource and a participant in the distributed load-sharing network. Logical storage units can be dynamically reassigned between VIOS based on utilization needs, allowing the system to adapt to varying workload patterns and achieve efficient load distribution across multiple servers.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If logical storage units are transferred between VIOS to balance cache utilization, then performance bottlenecks are reduced, but system complexity increases

Engineering Contradiction:
Improveperformance consistencyVSAvoidload balancing mechanism
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The load balancing system operates autonomously by automatically monitoring cache utilization levels, detecting imbalances, and transferring logical storage units without requiring manual intervention. The system self-regulates to maintain performance consistency, reducing the operational complexity despite the sophisticated balancing mechanism.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10740157B2Cache load balancing in a virtual input/output server
Publication Date: 2020.08.11 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10740157B2 patent drawing
  • US10740157B2 patent drawing
  • US10740157B2 patent drawing

AI summary

Methods, systems, and computer program products for performing cache load balancing between multiple virtual input/output servers (VIOSs) are provided. Aspects include monitoring a utilization level for a cache in each of at least two VIOSs and determining that an imbalance exists between the utilization levels of the at least two VIOSs. Aspects also include transferring at least one logical storage unit between the at least two VIOSs, wherein the transferring reduces the imbalance.