Dynamic Storage Volume Data Copying with Hash Verification

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data storage systems face challenges in verifying the validity of copied data, especially when the source volume is dynamic and undergoes changes during the copying process, making it difficult to ensure that the copied data is a complete and accurate representation of the original data.

Innovation Solution

The method involves generating and storing hash values for the blocks in the source volume, copying these blocks to a destination volume, and then verifying the copied data by comparing hash values, while allowing for changes to the source volume during the copying process by using change maps to track and update the hash values accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data copying is performed on a dynamic storage volume, then the copying process can be completed, but the source volume changes during copying making verification difficult

Engineering Contradiction:

Improvecopying speedVSAvoiddata verification accuracy

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system generates and stores hash values for all blocks in the source volume before the copying process begins. These pre-computed hash values serve as reference points for later verification, allowing the copy to be verified even though the source volume continues to change during and after copying.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system implements a feedback mechanism where hash values are continuously updated and tracked. Change maps record which blocks have been modified, and this information feeds back into the verification process to determine which blocks need to be re-copied and verified, ensuring data integrity despite ongoing changes.

Inventive Principle:

Principle #23Feedback

2Ease of operation

If the source volume is allowed to change during copying, then normal operations continue without interruption, but the copied data may not match the original

Engineering Contradiction:

Improveoperational continuityVSAvoidcopy accuracy

Core Design Contradiction:

Ease of operationVSManufacturing precision

Solution Approach 1:

Hash values are pre-computed and stored for all source blocks before copying begins. This preliminary action creates a baseline reference that allows the system to track changes and verify copies even as the source volume evolves during normal operations.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system dynamically updates hash values as blocks are modified in the source volume. By tracking parameter changes (block modifications) and updating the corresponding hash values and change maps, the system maintains accuracy information without interrupting operations.

Inventive Principle:

Principle #35Parameter changes

3Reliability

If hash values are updated frequently to track changes, then data integrity is maintained, but the system complexity increases

Engineering Contradiction:

Improvedata integrityVSAvoidsystem complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system divides the volume into discrete blocks and maintains separate change maps for tracking modifications. This segmentation allows the system to manage complexity by handling individual blocks independently rather than managing the entire volume as a single unit.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Change maps serve as intermediary data structures that mediate between the source volume and the copied volume. These maps track which blocks have changed and need verification, simplifying the overall system by providing a clear interface for managing data integrity without requiring complex real-time synchronization mechanisms.

Inventive Principle:

Principle #24Intermediary (Mediator)

4Measurement precision

If verification is performed on all blocks, then complete accuracy is ensured, but the verification time increases

Engineering Contradiction:

Improveverification accuracyVSAvoidverification time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

Instead of verifying all blocks, the system performs verification only on blocks that have changed according to the change maps. This partial action approach maintains verification accuracy for relevant blocks while significantly reducing the time required compared to verifying the entire volume.

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The change maps provide feedback information about which blocks have been modified, allowing the verification process to focus only on those specific blocks. This feedback-driven approach ensures complete accuracy for changed blocks while avoiding unnecessary verification of unchanged blocks, thereby reducing overall verification time.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS9298390B2Systems and methods for copying data maintained in a dynamic storage volume and verifying the copied data

Publication Date: 2016.03.29 CIRRUS DATA SOLUTIONS

AI summary

A first volume comprising a plurality of blocks stored in a first location is accessed. A plurality of hash values representing the plurality of blocks is stored. The plurality of blocks is copied to a second volume stored in a second location, generating a copied volume. The copied volume is verified based on the plurality of hash values. In one embodiment, the first volume is altered, after the plurality of hash values is stored. Altering the first volume may include changing data in a selected one of the plurality of blocks. The first volume may be altered during copying of the plurality of blocks to the second volume.