Storage Controller Prefetching Data Access Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing storage systems face latency issues due to the use of different types of storage devices with varying access times, necessitating a method to manage data retrieval efficiently across these devices.
Innovation Solution
A storage system comprising a lower-latency primary storage medium and a higher-latency secondary storage medium, managed by a controller that determines data location, generates signals, and selects prefetching procedures based on criteria such as success metrics and computing resource availability, using either non-ML or ML-based algorithms to optimize data access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If a storage system uses multiple storage devices with different access latencies, then storage capacity and cost efficiency are improved, but data access latency increases
Solution Approach 1:
The system performs preliminary action by prefetching data from the second storage medium to the first storage medium before it is actually needed. The controller identifies data that is likely to be accessed soon based on access patterns and proactively loads it into the faster first storage medium, thereby reducing future access latency while maintaining the benefits of using slower, cheaper storage for capacity.
2Productivity
If the system continuously monitors and manages data prefetching, then data access performance is improved, but system complexity increases
Solution Approach 1:
The system implements self-service by having the controller automatically monitor access patterns, identify prefetch candidates, and manage data movement between storage media without external intervention. The controller self-adjusts prefetching behavior based on observed access patterns and system state, reducing the need for complex external management while maintaining high data access performance.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
One or more embodiments of the present disclosure describe a storage system comprising a first storage medium (120a), a second storage medium (120b), and a controller (118) configured to communicate with the first storage medium (120a) and the second storage medium (120b). The controller (118) is configured to receive a first request generated by a process associated with first data; determine whether the first data is stored in the first storage medium (120a); generate a signal based on the controller (118) being configured to determine; identify a criterion based on the signal; select, based on the criterion, at least one of a first procedure or a second procedure for loading second data from the second storage medium (120b) to the first storage medium (120a); and output the second data based on a second request generated by the process for the second data.