Dynamic Cache Policy Selection for Storage Workloads

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The availability of computing resources in storage systems is limited by the hardware components and their operational configurations, leading to suboptimal performance in providing computer-implemented services, as cache policies are not dynamically adapted to changing workloads, resulting in inefficient use of cache resources.

Innovation Solution

An information handling system that predicts future workload patterns using profile-based cache policy performance prediction models, obtains input-output profiles, calculates performance metrics, ranks cache policies, and updates cache operations to balance cache hits and pollution levels, thereby selecting and implementing optimal cache policies to enhance storage system efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If cache policies are statically configured, then device complexity is reduced, but productivity deteriorates due to inability to adapt to changing workloads

Engineering Contradiction:
Improvecache policy adaptabilityVSAvoidcache management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The cache policy is transformed from static to dynamic by continuously monitoring workload characteristics and automatically adjusting cache parameters. The system observes input-output patterns, identifies workload phases, and adapts cache policies in real-time to match changing access patterns, thereby achieving adaptability without manual intervention.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The cache management system performs self-adjustment by autonomously monitoring its own performance metrics and workload characteristics. It automatically detects when workload patterns change and selects appropriate cache policies without external control, enabling the system to serve itself and eliminate the need for complex external management mechanisms.

Inventive Principle:
Principle #25Self-service

2Productivity

If cache size is increased, then productivity improves through more cache hits, but loss of substance worsens due to increased cache pollution

Engineering Contradiction:
Improvecache hit rateVSAvoidcache pollution
Core Design Contradiction:
ProductivityVSLoss of substance

Solution Approach 1:

The cache replacement policy is made dynamic by adjusting eviction strategies based on observed workload characteristics. During sequential access phases, the system retains more data; during random access phases, it aggressively evicts less frequently accessed data. This dynamic adjustment maintains high cache hit rates while minimizing pollution from inappropriate data retention.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes cache operational parameters such as replacement policy type and eviction thresholds based on detected workload patterns. When sequential workloads are detected, parameters favor retention; when random workloads are detected, parameters favor aggressive replacement. This parameter adaptation optimizes the balance between cache hits and pollution without changing physical cache size.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11379375B1System and method for cache management
Publication Date: 2022.07.05 EMC IP HLDG CO LLC
  • US11379375B1 patent drawing
  • US11379375B1 patent drawing
  • US11379375B1 patent drawing

AI summary

An information handling system for managing a storage system includes storage for storing profile-based cache policy performance prediction models. The information handling system also includes a storage manager that obtains an input-output profile for a workload hosted by the information handling system during a first period of time; obtains performance metrics for cache policies for the storage system using: the input-output profile, and the profile-based cache policy performance prediction models; obtains a ranking of the cache policies based on the performance metrics; selects a cache policy of the cache policies based on the rankings; and updates operation of a cache of the storage system based on the selected cache policy for a second period of time.