Fingerprint Translation for Disparate Deduplication Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Duplicating deduplicated data between disparate deduplication systems is inefficient due to the use of different fingerprint algorithms, requiring data rehydration and re-deduplication, which is resource-intensive and cumbersome.
Innovation Solution
Generating source fingerprints for data blocks using a source fingerprint algorithm and determining if they are new or modified, then generating target fingerprints using a target fingerprint algorithm, and sending these to the target deduplication system, allowing for efficient data migration without requiring both systems to use the same fingerprint methodology.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is duplicated between disparate deduplication systems using different fingerprint algorithms, then data migration can be performed, but the process requires rehydration and re-deduplication which is resource intensive and cumbersome
Solution Approach 1:
The patent introduces a translation layer that acts as an intermediary between source and target fingerprint algorithms. This translation mechanism converts source fingerprints into target fingerprints without requiring full data rehydration, thereby reducing computational overhead while maintaining compatibility between disparate deduplication systems
Solution Approach 2:
The system performs preliminary fingerprint translation before actual data duplication. By pre-converting fingerprints from the source algorithm to the target algorithm, the system prepares data for efficient ingestion into the target deduplication system without requiring resource-intensive re-deduplication operations
2Productivity
If data blocks are sent between deduplication systems, then duplication is achieved, but transmitting all data blocks including duplicates increases network traffic and storage overhead
Solution Approach 1:
The system extracts only the essential identification information (fingerprints) from data blocks for transmission between deduplication systems. By sending compact fingerprint representations rather than complete data blocks, the system achieves duplication coordination while dramatically reducing network traffic and data transmission volume
Solution Approach 2:
The patent segments the data duplication process into fingerprint generation, fingerprint translation, and selective data block transmission phases. This segmentation allows the system to first identify which data blocks need to be duplicated through fingerprint comparison, then transmit only those specific blocks, avoiding unnecessary network traffic
Data Source
AI summary
Disclosed herein are methods, systems, and processes to improve the duplication of data between disparate deduplication systems. Source fingerprints are generated for data blocks using a source fingerprint algorithm at a source deduplication system. The source fingerprints and previously-generated source fingerprints are used to determine whether the data blocks are new or modified. If the data blocks are new or modified, target fingerprints are generated for the data blocks using a target fingerprint algorithm associated with a target deduplication system. The target fingerprints are sent to the target deduplication system.