Dynamic Prefetching Engine for Storage Cache Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In storage systems, prefetching data into a cache can lead to resource conflicts and wasted resource usage due to high I/O loads and cache fullness, making it difficult to determine when to turn prefetching on or off, especially when the I/O load changes rapidly.

Innovation Solution

A dynamic prefetching engine adjusts the prefetching load based on measures such as past cache utilization and resource conflicts, dynamically increasing or decreasing the number of prefetch threads to optimize cache usage and reduce conflicts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If prefetching is enabled to improve cache utilization and access speed, then cache hit rate increases, but resource conflicts and wasted resource usage occur when I/O load is high

Engineering Contradiction:
Improvedata access speedVSAvoidresource waste
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The patent implements dynamic adjustment of prefetching operations based on real-time cache fullness metrics and I/O load conditions. The system monitors cache utilization and automatically modulates prefetching intensity, transitioning from static prefetching to adaptive dynamic prefetching that responds to changing system states, thereby avoiding resource waste during high I/O loads while maintaining performance benefits during lower load conditions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms by continuously monitoring cache fullness metrics and I/O load conditions, then using this information to adjust prefetching operations. This closed-loop control allows the system to detect when cache resources are becoming saturated and reduce prefetching accordingly, preventing resource conflicts and wasted energy while maintaining optimal performance when resources are available

Inventive Principle:
Principle #23Feedback

2Productivity

If prefetching load is increased to handle high I/O loads, then more data can be cached, but resource conflicts in cache accesses increase

Engineering Contradiction:
ImproveI/O processing capacityVSAvoidresource conflicts
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The patent implements dynamic adjustment of prefetching operations based on real-time cache fullness metrics and I/O load conditions. The system monitors cache utilization and automatically modulates prefetching intensity, transitioning from static prefetching to adaptive dynamic prefetching that responds to changing system states, thereby avoiding resource waste during high I/O loads while maintaining performance benefits during lower load conditions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters by adjusting prefetching load based on monitored cache fullness metrics. When cache utilization exceeds thresholds, the system reduces prefetching intensity or suspends prefetching temporarily, dynamically changing the prefetching rate parameter to balance I/O processing capacity with resource conflict avoidance

Inventive Principle:
Principle #35Parameter changes

3Stability of the object's composition

If prefetching is continuously active to maintain cache fullness, then cache utilization improves, but it becomes difficult to adapt when I/O load changes rapidly

Engineering Contradiction:
Improvecache fullnessVSAvoidresponse to I/O load changes
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic adjustment of prefetching operations based on real-time cache fullness metrics and I/O load conditions. The system monitors cache utilization and automatically modulates prefetching intensity, transitioning from static prefetching to adaptive dynamic prefetching that responds to changing system states, thereby avoiding resource waste during high I/O loads while maintaining performance benefits during lower load conditions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system employs feedback mechanisms by continuously monitoring cache fullness metrics and I/O load conditions, then using this information to adjust prefetching operations. This closed-loop control allows the system to detect when cache resources are becoming saturated and reduce prefetching accordingly, preventing resource conflicts and wasted energy while maintaining optimal performance when resources are available

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11853221B2Dynamic prefetching of data from storage
Publication Date: 2023.12.26 HEWLETT PACKARD ENTERPRISE DEV LP
  • US11853221B2 patent drawing
  • US11853221B2 patent drawing
  • US11853221B2 patent drawing

AI summary

In some examples, a system dynamically adjusts a prefetching load with respect to a prefetch cache based on a measure of past utilizations of the prefetch cache, wherein the prefetching load is to prefetch data from storage into the prefetch cache.