Cache Management for Write Requests Across Storage Groups

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current cache management systems face challenges in optimizing write latency by balancing temporal and spatial locality, as they struggle to efficiently manage write requests across different storage groups with varying cache occupancy thresholds.

Innovation Solution

The system determines high and low thresholds for each storage group to manage cache occupancy and assigns tasks to destage write requests, using circular linked lists to order entries by storage location and update bits to prioritize spatial proximity, while adjusting task numbers based on cache occupancy to maintain optimal write throughput.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If the LRU cache technique is used to optimize temporal locality, then the number of destage operations is minimized, but spatial locality is not exploited and write throughput to storage is reduced

Engineering Contradiction:
Improvedestage operation frequencyVSAvoidwrite throughput to storage
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent segments the cache management into two independent algorithms: LRU for selecting which write requests to destage (minimizing destage operations through temporal locality optimization) and WOW for ordering the destage operations (maximizing write throughput through spatial locality exploitation). This segmentation allows both algorithms to operate independently and simultaneously optimize their respective objectives without interference.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges the LRU selection mechanism with the WOW ordering mechanism into a unified cache management system. The LRU algorithm identifies candidate write requests for destaging based on temporal locality, while the WOW algorithm reorders these candidates based on spatial proximity to storage locations, creating a combined approach that achieves both temporal and spatial locality optimization.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of time

If write requests are destaged immediately upon cache entry to reduce write latency, then response time is improved, but the cache occupancy decreases and temporal locality optimization is reduced

Engineering Contradiction:
Improvewrite latencyVSAvoidcache occupancy
Core Design Contradiction:
Loss of timeVSQuantity of substance

Solution Approach 1:

The patent implements dynamic cache occupancy thresholds that adjust based on system conditions and storage group performance characteristics. The thresholds are not fixed but adaptively change to balance write latency and cache occupancy, allowing the system to maintain optimal performance across varying workloads and storage conditions.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of cache occupancy threshold from a static value to a dynamic, adjustable parameter. By modifying this parameter based on system state and performance requirements, the system can optimize the balance between write latency (faster destaging) and cache occupancy (slower destaging) according to current operational needs.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If multiple storage groups are supported with different performance characteristics, then system versatility is improved, but the complexity of cache management increases

Engineering Contradiction:
Improvemulti-storage group supportVSAvoidcache management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the cache management system into storage group-independent components (LRU algorithm, WOW algorithm) and storage group-specific parameters (performance characteristics, occupancy thresholds). This segmentation allows the core algorithms to remain simple and universal while accommodating multiple storage groups through parameter configuration rather than structural complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal cache management framework where the LRU and WOW algorithms can handle any number of storage groups with different performance characteristics. The system is designed to be multi-functional, supporting heterogeneous storage groups through a single unified management mechanism that adapts to different storage group configurations without requiring separate management logic for each group.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS7721043B2Managing write requests in cache directed to different storage groups
Publication Date: 2010.05.18 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US7721043B2 patent drawing
  • US7721043B2 patent drawing
  • US7721043B2 patent drawing

AI summary

Provided are a method, system, and article of manufacture for managing write requests in cache directed to different storage groups. A determination is made of a high and low thresholds for a plurality of storage groups configured in a storage, wherein the high and low thresholds for one storage group indicate a high and low percentage of a cache that may be used to store write requests to the storage group. A determination is made of a number of tasks to assign to the storage groups based on the determined high and low thresholds for the storage groups, wherein each task assigned to one storage group destages write requests from the cache to the storage group.