Deduplicated Data Backup with Multi-Copy Storage on Separate Media
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data deduplication backup methods face challenges in efficiently storing and restoring deduplicated data, particularly when data is backed up to removable media, as they risk loss if a single data storage media is corrupted, leading to potential reconstruction issues and increased storage needs.
Innovation Solution
A system that determines multiple references for each data block and stores at least two copies of data blocks with multiple references on separate media, using thresholds to manage storage and minimize loss risks, allowing for direct copying of data contexts and reducing the need for extensive reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If deduplicated data is stored on removable media to reduce storage costs, then storage costs are reduced, but data reliability deteriorates due to risk of media corruption and loss
Solution Approach 1:
The system segments data into data blocks and tracks references separately. By dividing the backup into individual data blocks and maintaining a reference map, the system can store data efficiently on removable media while identifying which blocks need protection through multiple copies.
Solution Approach 2:
The system performs preliminary analysis of the deduplicated data to identify data blocks with multiple references before finalizing the backup strategy. This allows proactive determination of which blocks require multiple copies, preventing data loss before it occurs.
2Reliability
If multiple copies of data blocks are stored on separate media to prevent data loss, then data reliability is improved, but storage media requirements increase
Solution Approach 1:
The system applies different storage strategies to different data blocks based on their reference characteristics. Data blocks with multiple references receive multiple copies on separate media, while unique blocks use standard single-copy storage, optimizing reliability without unnecessarily increasing media requirements for all data.
Solution Approach 2:
The system dynamically determines the number of copies based on the reference count parameter of each data block. By changing the replication parameter selectively rather than uniformly, the system balances reliability improvements with storage media consumption.
3Ease of operation
If deduplicated data is reconstructed before backup to removable media, then data accessibility is improved, but storage expansion increases significantly
Solution Approach 1:
The system extracts and stores only the essential reference information and data blocks on removable media, rather than reconstructing complete data sets. This selective extraction approach maintains accessibility while avoiding the exponential storage expansion that would result from full reconstruction.
Solution Approach 2:
The system creates simplified copies of the deduplicated data structure (data blocks and reference maps) rather than full reconstructed data sets. This allows rapid restoration by copying essential components without the storage overhead of complete data reconstruction.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods and systems back up deduplicated data to data storage media, the deduplicated data comprising a plurality of data blocks referenced for deduplication. In one embodiment, the existence of multiple references to each of the data blocks is determined; and at least two copies of at least each data block having multiple references thereto is stored, each to a separate data storage media. In another embodiment, the references to each of the data blocks is determined; the total of multiple references is compared to a percentage threshold; and multiple copies are stored for all the data blocks where the percentage threshold is exceeded.