Asynchronous Data Replication Snapshot Segmentation

Solution Overview

Problem

Asynchronous data replication is inefficient and prone to data loss when dealing with large data sets due to the time-consuming nature of original replication, which affects subsequent incremental backups and increases the risk of data loss.

Innovation Solution

The method involves taking snapshots before and after a data subset is replicated, determining the differences between these snapshots to identify a second subset, and dividing the original replication into multiple stages, allowing for more efficient data protection by reducing the time interval between snapshots.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If original replication is performed first before incremental replication, then complete data backup is achieved, but replication time becomes excessively long and affects subsequent incremental backups

Engineering Contradiction:

Improvedata protection completenessVSAvoidreplication time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the data block set into multiple subsets and performs replication in multiple stages. Instead of replicating all data at once, the system divides the data into portions, replicates them sequentially, and uses snapshots to track progress. This segmentation reduces the time each replication stage takes while ensuring complete data protection through the use of snapshots to capture the state before and after each stage.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent takes a snapshot of the data block set before starting replication and another snapshot after replication is completed. These preliminary actions capture the data state at different points, enabling the system to determine which data blocks have changed and need to be replicated. This preliminary snapshotting action allows for efficient identification of only the necessary data to be replicated, reducing overall replication time.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If original replication is performed first, then incremental replication can be performed, but the long original replication period increases the possibility of data loss

Engineering Contradiction:

Improvedata backup effectivenessVSAvoiddata loss risk

Core Design Contradiction:

ReliabilityVSLoss of information

Solution Approach 1:

The patent takes a snapshot of the data block set before starting replication and another snapshot after replication is completed. These preliminary actions capture the data state at different points, enabling the system to determine which data blocks have changed and need to be replicated. This preliminary snapshotting action allows for efficient identification of only the necessary data to be replicated, reducing overall replication time.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent uses snapshots to provide feedback about the data state before and after replication. By comparing snapshots, the system receives feedback on which data blocks have changed and need to be replicated in subsequent stages. This feedback mechanism ensures that no data is lost while minimizing the time window during which data loss could occur.

Inventive Principle:

Principle #23Feedback

3Reliability

If large data sets are replicated over network, then complete backup is achieved, but network bandwidth limitations cause extended replication time

Engineering Contradiction:

Improvedata protection coverageVSAvoidreplication efficiency

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent extracts only the necessary data blocks for replication by comparing snapshots. Instead of replicating entire data sets, the system identifies and extracts only the data blocks that have changed between snapshots. This extraction approach significantly reduces the amount of data that needs to be transmitted over the network, improving replication efficiency while maintaining complete data protection coverage.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the data block set into multiple subsets and performs replication in multiple stages. Instead of replicating all data at once, the system divides the data into portions, replicates them sequentially, and uses snapshots to track progress. This segmentation reduces the time each replication stage takes while ensuring complete data protection through the use of snapshots to capture the state before and after each stage.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS11442895B2Method for copying data, electronic device and computer program product

Publication Date: 2022.09.13 EMC IP HLDG CO LLC

AI summary

Techniques for replicating data involve: acquiring a first snapshot of a data block set, the first snapshot being a snapshot before a first subset of the data block set starts to be replicated; acquiring a second snapshot of the data block set, the second snapshot being a snapshot of the data block set when replication of the first subset is completed; and determining, based on a difference between the second snapshot and the first snapshot, a second subset of the data block set, the second subset being different from the first subset. Accordingly, such techniques can improve data protection efficiency in asynchronous replication.