Parity-Based Data Recovery for Distributed Storage Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing RAID systems lack sufficient redundancy and resilience to handle multiple simultaneous failures, particularly in distributed or ad-hoc storage mechanisms where data loss or corruption can occur across remote storage devices or networks.
Innovation Solution
A method of generating multiple sets of parity data for each data subset, using the XOR logical operator, to ensure data protection and recovery by dividing data into subsets and generating parity data for each subset and its neighbors, allowing for recovery from multiple failures and distributed storage across various locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional RAID parity schemes are used, then data redundancy is provided for single failure, but the system cannot handle multiple simultaneous failures
Solution Approach 1:
The data is divided into multiple data subsets, and multiple different parity subsets are generated for each data subset. This segmentation allows the system to handle multiple simultaneous failures by distributing redundancy across multiple parity sets rather than relying on a single parity mechanism.
Solution Approach 2:
The patent extends the traditional single-dimension parity protection by creating multiple parity subsets (first parity subset, second parity subset, etc.) for each data subset. This adds another dimension to the redundancy structure, enabling recovery from multiple simultaneous failures that would overwhelm traditional single-parity systems.
2Adaptability or versatility
If distributed storage mechanisms are used, then storage flexibility and accessibility are improved, but redundancy becomes insufficient for remote storage devices
Solution Approach 1:
The system performs preliminary action by generating multiple different parity subsets for each data subset before storage or transmission. This pre-computed redundancy is distributed across multiple locations, ensuring that even if remote storage devices fail, the data can be recovered using the pre-established multiple parity sets.
Solution Approach 2:
The multiple parity subsets serve multiple functions: they can protect against single failures, multiple simultaneous failures, and can be used in both centralized and distributed storage environments. This universal approach makes the system adaptable to various storage architectures while maintaining strong data protection.
3Reliability
If multiple parity data sets are generated for each data subset, then resilience to multiple failures is improved, but computational complexity increases
Solution Approach 1:
The patent changes the parameter of redundancy by generating multiple different parity subsets instead of a single parity subset. While this increases the number of parity sets, the computational complexity remains manageable because each parity subset is generated using the same XOR-based method, just applied to different combinations of data subsets.
Solution Approach 2:
The system creates copies of parity information in multiple different forms (first parity subset, second parity subset, etc.). These copied parity sets are generated using systematic methods based on XOR operations, which keeps the computational complexity comparable to traditional parity generation while providing enhanced recovery capabilities.
Data Source
AI summary
Method and apparatus for protecting data comprising dividing data into a plurality of data subsets. Generating parity data for each data subset and another data subset of the plurality of data subsets. Generating parity data for each data subset and a second other data subset of the plurality of data subsets. Method and apparatus for recovering data comprising retrieving one or more data subsets. Retrieving two or more different parity data sets generated for one data subset. Regenerating any missing data subsets using the retrieved one or more data subset and two or more retrieved parity data sets. Combining the one or more retrieved data subset and regenerated missing data subsets to form the recovered data.