RAID Load Balancing via Dynamic IOPS Monitoring

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Data storage arrays often experience uneven workload distribution among individual data drives, leading to unbalanced loads that can impact performance and availability.

Innovation Solution

A method to determine load values for each storage target within a RAID group, comparing these values to identify underutilization, acceptable, and overutilization ranges, and repositioning data between targets to achieve load balance by moving data from overutilized to underutilized drives.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is stored on multiple storage targets in a RAID group, then data availability is improved, but workload distribution becomes unbalanced leading to performance degradation

Engineering Contradiction:

Improvedata availabilityVSAvoidworkload distribution

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The system continuously monitors IOPS metrics for each storage target and uses this feedback to dynamically adjust data placement. The load balancing mechanism compares actual IOPS against thresholds and automatically migrates data from over-utilized to under-utilized storage targets, creating a closed-loop control system that maintains balanced workload distribution while preserving RAID group redundancy

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent implements dynamic load balancing by continuously evaluating IOPS metrics and adjusting data placement in real-time. Storage targets transition between states (under-utilized, balanced, over-utilized) based on changing workload conditions, and the system adapts data migration decisions accordingly to maintain optimal performance across the RAID group

Inventive Principle:

Principle #15Dynamics

2Quantity of substance

If workload is distributed across multiple storage targets, then system capacity is improved, but uneven load distribution causes performance bottlenecks

Engineering Contradiction:

Improvestorage capacityVSAvoidIOPS performance

Core Design Contradiction:

Quantity of substanceVSProductivity

Solution Approach 1:

The system changes the operational parameters of storage targets by monitoring IOPS metrics and identifying when targets transition between under-utilized, balanced, and over-utilized states. Based on these parameter changes, the system dynamically adjusts data placement decisions to redistribute workload and maintain optimal IOPS performance across all storage targets in the RAID group

Inventive Principle:

Principle #35Parameter changes

3Productivity

If data is repositioned between storage targets to balance load, then performance is improved, but system complexity increases

Engineering Contradiction:

Improveload balancing performanceVSAvoiddata repositioning mechanism

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The load balancing system operates autonomously by automatically monitoring IOPS metrics, comparing loads between storage targets, and executing data migration decisions without manual intervention. The system serves itself by detecting imbalances and correcting them through automated data repositioning, reducing the need for external management while maintaining performance

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS10061525B1Load balancing system and method

Publication Date: 2018.08.28 EMC IP HLDG CO LLC

AI summary

A method, computer program product, and computing system for determining a load value for each of a plurality of storage targets included within a RAID group, thus defining a plurality of load values. The plurality of load values are compared to determine if the RAID group is load balanced. If the RAID group is not load balanced, data is repositioned between the plurality of storage targets.