Multi-tier Data Recovery via Segmented Erasure Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data recovery technologies are inefficient due to the high bandwidth requirements during the reconstitution and transfer of deduplicated data, which counteracts the storage space and bandwidth savings achieved through deduplication.
Innovation Solution
A data system with a backup service, data index, and recovery service that uses hash values to efficiently locate and recover data by segmenting files, utilizing local and remote data sources, and prioritizing data transfer based on geographical and resource considerations, thereby reducing bandwidth consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is deduplicated and stored remotely, then storage space efficiency is improved, but bandwidth consumption during recovery increases
Solution Approach 1:
The patent segments files into smaller data blocks and further divides them into erasure coding segments. This segmentation allows the system to store only unique data blocks remotely while keeping segment information locally, enabling efficient recovery with minimal bandwidth consumption by reconstructing only missing segments rather than transferring entire files.
Solution Approach 2:
The patent implements a nested structure where erasure coding segments are contained within data blocks, which are in turn contained within files. This hierarchical nesting allows the system to operate at multiple levels of granularity, transferring only the necessary nested components during recovery rather than entire file structures.
2Reliability
If all data is transferred during recovery, then data integrity is ensured, but recovery time and bandwidth usage increase
Solution Approach 1:
The patent extracts and transfers only the specific erasure coding segments that are missing or corrupted, rather than transferring all data blocks. The erasure coding algorithm enables reconstruction of original data from a subset of segments, allowing the system to extract and transfer only the minimum necessary data to ensure data integrity while reducing recovery time.
Solution Approach 2:
The patent applies partial action by transferring only the portion of data segments needed for recovery rather than complete data sets. The erasure coding scheme is designed to tolerate loss of some segments, allowing recovery with partial data transfer, thus reducing both bandwidth consumption and recovery time while maintaining data integrity.
Data Source
AI summary
A method, article of manufacture, and apparatus for restoring data. In some embodiments, this includes backing up data in a first form with a backup application, updating the backup application, and using the updated backup application to restore the backed up data in a second form. In some embodiments, the first form includes a backup image. In some embodiments, the second form is individual files.