Incremental Replication Between Foreign Storage Systems

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data replication techniques face challenges in implementing incremental replication between data storage systems, especially in cases of intermediate system failures during dataset transfer between multiple storage systems.

Innovation Solution

A data storage system with a handshake component, dataset analysis component, and incremental transfer component that establishes connections, compares dataset versions, and transfers differentials between storage systems, enabling incremental replication even between systems without a previous direct relationship.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If incremental replication is implemented between storage systems, then network bandwidth usage and computing resources are reduced, but reliability deteriorates in cases of intermediate system failure

Engineering Contradiction:

Improvenetwork bandwidth usageVSAvoidreplication reliability

Core Design Contradiction:

Loss of energyVSReliability

Solution Approach 1:

The source storage system proactively generates and stores differential data representing changes to the dataset before replication is needed. This preliminary action ensures that when incremental replication is required, the differential data is already prepared and can be transferred efficiently without requiring intermediate systems to maintain state, thus resolving the contradiction between reduced bandwidth usage and maintained reliability

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces a differential data structure as an intermediary representation of dataset changes. This differential data serves as a mediator that can be independently transferred and applied by target storage systems without requiring the target to understand or maintain knowledge of intermediate systems in the replication chain, thereby enabling reliable incremental replication even when intermediate systems fail

Inventive Principle:

Principle #24Intermediary (Mediator)

2Use of energy by moving object

If incremental replication is implemented between storage systems, then computing resources are reduced, but reliability deteriorates in cases of intermediate system failure

Engineering Contradiction:

Improvecomputing resourcesVSAvoidreplication reliability

Core Design Contradiction:

Use of energy by moving objectVSReliability

Solution Approach 1:

The patent extracts the essential replication information by creating differential data that represents only the changes to the dataset. This extraction eliminates the need for target storage systems to process or store entire datasets multiple times, significantly reducing computing resources while the differential data structure ensures reliability by being self-contained and independent of intermediate system state

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of copying entire datasets incrementally which requires maintaining state across multiple systems, the patent creates a self-contained differential copy that captures all necessary changes. This copying approach reduces computing resources by transferring only essential change information while maintaining reliability through the self-contained nature of the differential data

Inventive Principle:

Principle #26Copying

3Reliability

If full dataset transfer is performed, then reliability is maintained, but network bandwidth usage and storage efficiency deteriorate

Engineering Contradiction:

Improvereplication reliabilityVSAvoidnetwork bandwidth usage

Core Design Contradiction:

ReliabilityVSLoss of energy

Solution Approach 1:

The patent extracts only the essential change information from the full dataset by generating differential data. This extraction maintains reliability by capturing all necessary modifications in a self-contained format while dramatically reducing network bandwidth usage by transferring only the differential portion rather than the entire dataset

Inventive Principle:

Principle #2Taking out (Extraction)

4Reliability

If full dataset transfer is performed, then replication reliability is maintained, but storage efficiency deteriorates

Engineering Contradiction:

Improvereplication reliabilityVSAvoidstorage efficiency

Core Design Contradiction:

ReliabilityVSLoss of substance

Solution Approach 1:

The patent extracts only the essential change information by creating differential data that represents modifications to the dataset. This approach maintains replication reliability by capturing all necessary changes in a compact, self-contained format while improving storage efficiency by avoiding redundant storage of unchanged data portions

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS11422733B2Incremental replication between foreign system dataset stores

Publication Date: 2022.08.23 EMC IP HLDG CO LLC

AI summary

Incremental replication between foreign system dataset stores is described herein. A method as described herein can include connecting to a target storage system to facilitate an initial transfer of a dataset from the system to the target storage system, wherein the system is distinct from the target storage system; in response to determining that a first version of the dataset is present on the target storage system, comparing the first version of the dataset to a second version of the dataset stored on the system; and, in response to determining that the second version of the dataset is more recent than the first version of the dataset, transferring a differential between the first version of the dataset and the second version of the dataset to the target storage system, the differential comprising less than all of the second version of the dataset.