Storage System Key Data Repair via Dual Cache Redundancy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional storage systems face significant downtime and manual recovery challenges when important metadata is corrupted, as they require manual data recovery tools that are time-consuming and disrupt normal system operation.
Innovation Solution
A method and system that identify key data based on importance and store it in multiple caches, allowing for automatic repair of corrupted data using corresponding data from another cache, thereby avoiding manual recovery and quickening the restoration of the storage system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If manual data recovery tools are used when metadata is corrupted, then data can be recovered, but system downtime increases and normal operation is disrupted
Solution Approach 1:
The system performs preliminary actions by creating and storing secondary cache data as a backup before the primary data is corrupted. This advance preparation enables immediate recovery without manual intervention when corruption occurs, directly reducing system downtime while maintaining data recovery capability
Solution Approach 2:
The system implements self-service through automatic detection of data corruption and autonomous repair using the secondary cache, eliminating the need for manual recovery tools and operations. This automation reduces downtime and prevents disruption of normal system operation
2Reliability
If key data is stored in multiple caches with automatic repair capability, then system reliability improves, but device complexity increases
Solution Approach 1:
The system creates a copy of the primary cache data and stores it in a secondary cache with identical structure and organization. This copying approach maintains reliability through redundancy while keeping the complexity manageable by using the same data format and storage structure in both caches
Solution Approach 2:
The system changes the state parameter of the data by marking it as non-removable in the secondary cache, enabling automatic repair functionality. This parameter change allows the system to distinguish between primary and secondary cache data, facilitating automated recovery without significantly increasing operational complexity
Data Source
AI summary
Techniques for managing a storage system involve: based on a degree of importance of data stored in a persistent storage device of the storage system, determining key data from the data, wherein a degree of importance of the key data is higher than a threshold degree; respectively identifying first data corresponding to the key data in a first cache of the storage system and second data corresponding to the key data in a second cache of the storage system as non-removable; and in response to corruption of the first data, repairing the first data using the second data in the second cache. Such techniques can avoid system shutdown caused by corruption of key data.