Asynchronous Replication Data Verification via Cycle Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional asynchronous replication methods in information processing systems are inefficient due to the need to verify all transferred data in each cycle, which prolongs the replication process and hinders the achievement of desired recover point objectives.

Innovation Solution

Implementing automatic verification of asynchronously replicated data by generating and comparing signatures over multiple cycles, allowing for incremental verification of target site snapshots with corresponding source site snapshots, thereby spreading the verification process across multiple cycles without requiring administrator intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all transferred data is verified in each cycle, then data integrity is ensured, but the replication cycle time is prolonged and efficiency is reduced

Engineering Contradiction:
Improvedata integrityVSAvoidreplication efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the verification process by dividing data into chunks and generating checksums for each chunk independently. Instead of verifying all data in each cycle, the system verifies specific chunks across multiple cycles, reducing the verification burden per cycle while maintaining overall data integrity through cumulative verification.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary actions by generating and transmitting checksums along with data chunks during the replication process. This allows the target storage system to have verification data ready in advance, enabling efficient verification without delaying the replication cycle.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If verification is performed in each cycle, then data equivalence is confirmed, but the recover point objective cannot be achieved

Engineering Contradiction:
Improvesnapshot equivalenceVSAvoidrecover point objective
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The verification process is segmented across multiple replication cycles rather than requiring complete verification in each cycle. The system tracks which data chunks have been verified and continues verification in subsequent cycles, allowing the recover point objective to be met while still ensuring snapshot equivalence through progressive verification.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements feedback mechanisms by tracking verification status of different data chunks and using this information to optimize future verification activities. The source and target storage systems exchange verification information to coordinate the incremental verification process, ensuring equivalence is eventually confirmed without delaying recovery objectives.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10437855B1Automatic verification of asynchronously replicated data
Publication Date: 2019.10.08 EMC IP HLDG CO LLC
  • US10437855B1 patent drawing
  • US10437855B1 patent drawing
  • US10437855B1 patent drawing

AI summary

An apparatus in one embodiment comprises a storage system having a plurality of storage devices. The storage system is associated with a target site and configured to participate in a cycle-based asynchronous replication process with a storage system of a source site. The storage system of the target site is configured to receive from the storage system of the source site, in respective ones of a plurality of cycles of the cycle-based asynchronous replication process, corresponding sets of differential data representing respective deltas between pairs of source site snapshots for respective pairs of the cycles. The storage system of the target site utilizes the sets of differential data received in the respective ones of the cycles to update respective target site snapshots for those cycles. Over multiple cycles, the storage system of the target site verifies that respective different portions of designated target site and source site snapshots are equivalent.