Deduplicated Data Duplication via Virtual References
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional duplication technologies for deduplicated data stores are time-consuming and inefficient, especially when duplicating data that is not yet present at the target location, leading to long wait times for data availability.
Innovation Solution
The method involves creating references between source and target deduplicated data storages, copying data blocks, and updating references to enable efficient duplication by using a Fibre Channel Protocol, allowing the target data store to become available before the actual data is copied, and managing data blocks through a reference table to prevent deletion until needed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional duplication technologies are used to copy data from source to target deduplicated data store, then data integrity is ensured, but the duplication process becomes time-consuming and the target data store becomes available much later
Solution Approach 1:
The patent creates virtual references at the target data store before the actual data is copied. This preliminary action allows the target data store to be marked as available immediately, while the actual data transfer occurs in the background. The virtual references point to the source data store initially, and are later updated to point to the copied data once transfer completes.
Solution Approach 2:
The patent introduces a reference table as an intermediary mechanism that manages the mapping between target data blocks and source data blocks. This reference table allows the system to decouple the availability of the target data store from the completion of the actual data copy, enabling the target to be accessible while data transfers in the background.
2Reliability
If data is copied sequentially from source to target deduplicated data store, then data integrity is maintained, but productivity and duplication speed are reduced
Solution Approach 1:
The system performs preliminary actions by creating virtual references and marking the target data store as available before the actual data copy begins. This allows the duplication process to appear complete immediately while data transfers in the background, significantly improving perceived productivity without compromising data integrity.
Solution Approach 2:
The patent enables continuous data transfer in the background while the target data store remains available for use. This continuous action allows the duplication process to proceed without interruption, maintaining data integrity while maximizing productivity by allowing simultaneous data transfer and data access.
3Reliability
If the target data store waits for complete data copying before becoming available, then data consistency is ensured, but the waiting time for users to access data increases significantly
Solution Approach 1:
The patent creates virtual references at the target data store before data copying completes, allowing the target to become available immediately. These virtual references initially point to the source data, ensuring consistency, and are later updated to point to the copied data once transfer completes, thus eliminating user wait time while maintaining data consistency.
Solution Approach 2:
The patent creates a copy of the reference structure (metadata) at the target data store immediately, while the actual data copies occur in the background. This allows the target data store to be available for user access immediately, with data consistency maintained through the reference update mechanism once copying completes.
Data Source
AI summary
Techniques for duplicating deduplicated data include identifying a connection between a source deduplicated data storage and a target deduplicated data storage. A location of a block of data is determined that is located on the source deduplicated data storage for copying to the target deduplicated data storage. A first reference on the target deduplicated data storage is created to the location of the block of data on the source deduplicated data storage. A second reference is created on the source deduplicated data storage to the location of the block of data on the source deduplicated data storage.