Deduplication-Based Storage Array Data Replication via Snapshot Signatures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data protection systems face inefficiencies in replicating and updating data across sites, particularly in deduplication-based storage systems, where identifying and transferring changed data efficiently is a challenge.
Innovation Solution
A method and apparatus that generate snapshots of a production storage volume at different points in time, calculate differences, read and send signatures, and replicate changed data to a secondary site using deduplication-based storage arrays, enabling efficient data replication without relying on journals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional data replication systems transfer all data blocks between sites, then data consistency is maintained, but network bandwidth consumption increases and replication efficiency decreases
Solution Approach 1:
The patent extracts only the changed data blocks from the complete data set by comparing snapshots and identifying differences. Instead of transferring all data blocks, the system extracts and transfers only the specific blocks that have changed between the production site and backup site, significantly reducing network bandwidth consumption while maintaining data consistency.
Solution Approach 2:
The patent segments the data into individual blocks and processes them independently. By dividing the data into block-level segments, the system can identify and transfer only the specific changed blocks rather than treating the entire data set as a single unit, improving replication efficiency and reducing network overhead.
2Reliability
If snapshots are generated frequently to capture data changes, then data protection accuracy improves, but storage overhead and processing time increase
Solution Approach 1:
The patent applies partial action by generating snapshots only when necessary to capture meaningful data changes. Instead of creating excessive snapshots at fixed intervals, the system determines when snapshots are needed based on actual data modification patterns, reducing processing time while maintaining adequate data protection accuracy.
Solution Approach 2:
The system performs self-service by automatically comparing snapshots and identifying changed blocks without requiring manual intervention. The patent implements automated snapshot comparison and change detection mechanisms that reduce the time and resources needed for snapshot processing while maintaining high data protection accuracy.
3Quantity of substance
If deduplication is implemented at the data block level, then storage efficiency improves, but the complexity of identifying and transferring changed blocks increases
Solution Approach 1:
The patent introduces an intermediary layer of block-level metadata and change tracking mechanisms that simplify the identification of changed blocks in deduplication environments. This intermediary structure manages the complexity of tracking changes across deduplicated data blocks while maintaining high storage efficiency, acting as a mediator between the deduplication storage system and the replication process.
Data Source
AI summary
In one aspect, a method to send a snapshot to a replication site includes generating a first snapshot of a production storage volume at a first point in time, generating a second snapshot of the production storage volume at a second point in time after the first point in time, obtaining differences between the first snapshot and the second snapshot, reading signatures from the production storage volume, sending the signatures to the replication site, writing the signatures to the replication site, reading data from changed locations in the second snapshot which is not at the replication site and sending the data from the changed locations to the replication site comprising a replica volume replicating the production storage volume. The production storage volume is part of a deduplication-based storage array.