Dynamic Local Cache Size Control for Storage Arrays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing storage systems with fixed-sized local caches often face inefficiencies, either wasting resources with large caches or becoming performance bottlenecks with small caches, as they fail to dynamically adjust to varying I/O operations, leading to suboptimal workload latencies and I/O operations per second (IOPS) performance.

Innovation Solution

The solution involves dynamically controlling the size of a local cache by allocating or deallocating cache memory from a global memory based on predicted I/O operations, using predictive processing units to anticipate I/O workloads and adjust cache resources without affecting quality of service (QoS), thereby optimizing cache size for read and write operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If a large fixed-sized local cache is allocated, then read cache hits increase and access times reduce, but memory resources are wasted and I/O operations per second (IOPS) performance decreases

Engineering Contradiction:
Improveaccess timeVSAvoidmemory resource waste
Core Design Contradiction:
Loss of timeVSLoss of energy

Solution Approach 1:

The patent implements dynamic cache size adjustment by continuously monitoring I/O workload characteristics and automatically resizing the local cache accordingly. The cache management system transitions from a static fixed-size allocation to a dynamic mechanism that expands or contracts cache capacity based on real-time workload analysis, thereby optimizing the balance between read cache hits and memory resource utilization.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the cache size parameter dynamically based on workload conditions. By analyzing I/O operation patterns, the system adjusts the cache capacity parameter to match actual demand, preventing both resource waste from oversized caches and performance degradation from undersized caches.

Inventive Principle:
Principle #35Parameter changes

2Loss of energy

If a small fixed-sized local cache is allocated, then memory resources are conserved, but the cache becomes a performance bottleneck with increased workload latencies and reduced IOPS

Engineering Contradiction:
Improvememory resource efficiencyVSAvoidIOPS performance
Core Design Contradiction:
Loss of energyVSProductivity

Solution Approach 1:

The patent implements dynamic cache size adjustment by continuously monitoring I/O workload characteristics and automatically resizing the local cache accordingly. The cache management system transitions from a static fixed-size allocation to a dynamic mechanism that expands or contracts cache capacity based on real-time workload analysis, thereby optimizing the balance between read cache hits and memory resource utilization.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system performs preliminary analysis of I/O workload patterns to predict future cache requirements. By analyzing historical and current I/O operation characteristics, the system proactively adjusts cache size before performance degradation occurs, ensuring adequate cache capacity is available to handle anticipated workload demands.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If a fixed-sized cache is used, then system complexity is reduced, but the system cannot adapt to varying I/O workloads leading to suboptimal performance

Engineering Contradiction:
Improvecache management simplicityVSAvoidworkload adaptability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The cache management system operates autonomously by self-monitoring I/O workload characteristics and self-adjusting cache size without requiring external intervention or complex manual configuration. The system services itself by automatically analyzing workload patterns and making real-time cache size decisions, thereby achieving high adaptability while maintaining operational simplicity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements a feedback mechanism where I/O workload performance metrics are continuously monitored and fed back to the cache management logic. This feedback loop enables the system to automatically adjust cache size in response to changing workload conditions, achieving adaptability through a relatively simple closed-loop control mechanism.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11138123B2Local cache size control in a storage array
Publication Date: 2021.10.05 EMC IP HLDG CO LLC
  • US11138123B2 patent drawing
  • US11138123B2 patent drawing
  • US11138123B2 patent drawing

AI summary

Embodiments of the present disclosure relate to an apparatus comprising a memory and at least one processor. The at least one processor is configured to: analyze input/output (I/O) operations received by a storage system; dynamically predict anticipated I/O operations of the storage system based on the analysis; and dynamically control a size of a local cache of the storage system based on the anticipated I/O operations.