Cyclical Workload Prediction for Multi-Tier Storage Overload Prevention

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In multi-tier storage systems, peak cyclical workloads during downtimes can lead to overloading of higher-tier storage devices when demand spikes after downtimes, resulting in performance degradation due to excessive data movement during low-demand periods.

Innovation Solution

A method that collects workload information over time to determine peak workloads and set maximum workload thresholds, preventing additional workload from being moved to devices when it would cause overload, thereby maintaining optimal performance by balancing workload distribution across tiers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data is moved to higher tier during cyclical downtime based on long-term demand, then storage resource utilization is improved, but storage device overload occurs when demand spikes after downtime

Engineering Contradiction:
Improvestorage resource utilizationVSAvoidstorage device overload
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary actions by moving data to higher tier storage during low-demand periods, but now with the added safeguard of predicting future demand spikes. The workload prediction mechanism identifies cyclical patterns (weekend vs. weekday) and prevents data movement actions that would lead to overload conditions, thus preparing the system in advance to avoid reliability issues while maintaining productivity benefits.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts data movement decisions based on real-time workload predictions and historical patterns. Instead of static tiering rules, the system continuously monitors workload characteristics and modifies data placement strategies accordingly - preventing moves to higher tiers when prediction indicates upcoming demand spikes, while allowing moves during periods of sustained low demand.

Inventive Principle:
Principle #15Dynamics

2Speed

If automatic data placement is used to optimize accessibility, then data access performance is improved, but workload distribution becomes unbalanced during cyclical demand patterns

Engineering Contradiction:
Improvedata access performanceVSAvoidworkload distribution balance
Core Design Contradiction:
SpeedVSStability of the object's composition

Solution Approach 1:

The system implements feedback mechanisms by continuously monitoring actual workload patterns and comparing them against predicted patterns. When cyclical demand patterns are detected (such as weekend lows followed by weekday spikes), the system adjusts data placement decisions in response to this feedback, preventing imbalance while maintaining optimal access performance through adaptive tiering strategies.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system changes operational parameters by dynamically adjusting data movement thresholds and tiering decisions based on detected workload patterns. When cyclical patterns are identified, the system modifies placement parameters to account for upcoming demand changes, thus maintaining workload distribution balance while preserving data access performance through context-aware tiering.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11399064B2Peak cyclical workload-based storage management in a multi-tier storage environment
Publication Date: 2022.07.26 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11399064B2 patent drawing
  • US11399064B2 patent drawing
  • US11399064B2 patent drawing

AI summary

In one embodiment, a method for managing data includes collecting workload information for a data storage device in a data storage system over a period of time. A peak workload of the data storage device for the period of time is determined. A maximum workload threshold for the data storage device in the data storage system over the period of time is also determined. Movement of additional workload to the device in the data storage system is prevented during a subsequent period of time when the data storage device is predicted to be at about the peak workload for the data storage device in response to a determination that adding the additional workload would cause the workload of the device to exceed the maximum workload threshold.