Data Recovery via Dual Error Correction Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data recovery methods involving error correction codes require extensive I/O operations, leading to slow recovery speeds and increased risks of data loss due to high I/O loads and resource consumption when storage units are damaged.
Innovation Solution
A method that recovers data blocks from undamaged storage units, encodes them with a second error correction format, and stores the recovered blocks and parity blocks on new storage units, reducing the number of I/O operations and improving data processing efficiency and safety.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional data recovery methods are used, then data can be recovered from damaged storage units, but the recovery speed is slow and the risk of data loss increases due to extensive I/O operations
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing parity blocks alongside data blocks in the storage system. When a storage unit fails, these pre-computed parity blocks are immediately available for recovery without requiring time-consuming recalculations, thus speeding up the recovery process while maintaining safety
Solution Approach 2:
The patent uses copying by creating redundant copies of data and parity information across multiple storage units. This redundancy allows the system to recover data by copying information from healthy storage units to replace damaged ones, avoiding the need for extensive I/O operations to read and rewrite all data
2Reliability
If error correction codes are applied to all data blocks during recovery, then data integrity is maintained, but the number of I/O operations increases and resource consumption rises
Solution Approach 1:
The patent extracts the error correction function from the data recovery process by separating parity block calculation from the recovery operation. The parity blocks are pre-computed and stored independently, allowing recovery to proceed without extracting and re-processing error correction codes for all data blocks, thus reducing I/O operations and resource consumption while maintaining integrity
Solution Approach 2:
The patent applies parameter changes by changing the state of error correction blocks from being recalculated during recovery to being directly retrieved from pre-computed storage. This parameter change in the recovery process (from calculation mode to retrieval mode) significantly reduces the I/O operations required while maintaining data integrity
3Reliability
If multiple copies of data are stored for redundancy, then data safety is improved, but the disk utilization rate decreases
Solution Approach 1:
The patent applies local quality by differentiating between data blocks and parity blocks in terms of their storage and recovery characteristics. Parity blocks are stored locally with data blocks but are only accessed during recovery operations, allowing the system to maintain high redundancy ratios for safety while minimizing the impact on overall disk utilization through more efficient storage allocation
Data Source
AI summary
Data processing techniques comprise, in response to determining that a storage unit storing first data blocks is damaged, determining storage units associated with the storage unit, and obtaining second data blocks from the storage units, where the second data blocks and the first data blocks are generated by applying to data an error correction code in a first format. The method further comprises recovering the first data blocks based on the second data blocks. In addition, the method comprises generating error correction blocks by applying an error correction code in a second format to the recovered first data blocks, where the second format is different from the first format. The above techniques can reduce input/output operations and shortens the recovery time of data blocks, and further can reduce the risk of data loss even in an extremely bad situation.