Write Data Migration Between Storage Caches to Prevent Overdrive
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Non-volatile write caches in storage systems can become overdriven due to a bottleneck in write data arrival rates, leading to increased response times and potential data loss, as conventional techniques fail to effectively manage cache overflow.
Innovation Solution
A computer-implemented method generates a write data migration plan based on a routing table that specifies migration paths from a local storage system's cache to remote storage systems, redistributing write data to prevent cache overdrive by utilizing available cache space across multiple systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If write data is stored in local cache to reduce response time, then write performance is improved, but cache overdrive occurs when write data arrival rate exceeds cache capacity
Solution Approach 1:
The patent combines multiple storage systems into a unified cache pool, merging their cache resources to collectively store write data. This allows the system to aggregate cache capacity across multiple systems, preventing any single cache from becoming overdriven while maintaining fast write performance through the pooled cache resources.
Solution Approach 2:
The patent enables cache resources to serve multiple functions and multiple storage systems simultaneously. The same cache infrastructure provides write acceleration for multiple systems while also acting as a overflow buffer, making the cache resource universal and adaptable to varying workload demands across the storage network.
2Productivity
If cache space is allocated to store write data, then write throughput is improved, but available cache space is limited and cannot be dynamically expanded
Solution Approach 1:
The patent makes cache resources universal by allowing them to be shared across multiple storage systems and dynamically allocated based on demand. A single cache resource can serve different systems at different times, providing adaptive capacity that expands and contracts according to actual workload requirements rather than being fixed to individual systems.
Solution Approach 2:
The patent implements dynamic cache allocation where cache capacity is not statically assigned but dynamically adjusted based on real-time conditions. The system can dynamically migrate data between caches, allocate overflow space when needed, and release resources when demand decreases, making the cache capacity flexible and adaptive rather than fixed.
3Loss of time
If write data is quickly accepted into cache, then host response time is reduced, but data loss risk increases when cache becomes full
Solution Approach 1:
The patent prepares overflow cache spaces in advance by pre-establishing migration paths and identifying available cache resources across the storage network. When the local cache approaches capacity, the system already has predetermined destinations ready to receive overflow data, preventing data loss without requiring the host to wait for cache availability.
Solution Approach 2:
The patent introduces remote caches as intermediary storage between the local cache and permanent storage. When the local cache is full, data can be temporarily redirected to these intermediary caches, maintaining the write path open for the host while the data resides safely in the intermediary location until local cache space becomes available.
Data Source
AI summary
A computer-implemented method, according to one embodiment, includes obtaining information about a plurality of remote storage systems. Each of the remote storage systems includes a cache. The method further includes generating a routing table based on the information, the routing table indicating potential write data migration paths from a cache of a local storage system to the caches of the remote storage systems. A write data migration plan is generated based on the routing table. The write data migration plan specifies which of the caches of the remote storage systems to migrate at least some write data originally intended to be stored on the cache of the local storage system to. In response to a determination that a first predetermined condition associated with the cache of the local storage system is met, the method includes causing the write data migration plan to be performed.