Staged Data Restore With Deduplication

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In data storage systems employing deduplication methodologies, restoring data from a backup storage device to a primary storage device can fail due to insufficient space on the primary device, especially when the deduplication methodologies used by both devices are incompatible, leading to inadequate storage space and inefficient data transfer processes.

Innovation Solution

A system and method for performing staged restore operations, where data is segregated into subsets and transferred in stages, with deduplication operations initiated on the primary storage device between each transfer to optimize storage space and prevent failures, using a restore module that sorts data based on signatures to maximize duplicate segment inclusion in each subset and trigger deduplication operations accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data is rehydrated before transfer to ensure compatibility with different deduplication methodologies, then data transfer reliability is improved, but storage space on the primary device becomes insufficient

Engineering Contradiction:

Improvedata transfer reliabilityVSAvoidstorage space

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The restore operation is divided into multiple stages, with data transferred in segments rather than all at once. Between stages, deduplication operations are performed to free up space. This segmentation allows the system to maintain reliability by ensuring compatibility at each transfer stage while managing storage space constraints through periodic deduplication.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Deduplication operations are initiated on the primary storage device between data transfer stages to proactively create space for subsequent transfers. This preliminary action ensures that space constraints do not prevent the restore operation from completing, while still maintaining data transfer reliability through staged rehydrated transfers.

Inventive Principle:

Principle #10Preliminary action

2Quantity of substance

If data is transferred in staged operations with deduplication between stages, then storage space management is improved, but data transfer time increases

Engineering Contradiction:

Improvestorage space managementVSAvoiddata transfer time

Core Design Contradiction:

Quantity of substanceVSLoss of time

Solution Approach 1:

The restore operation uses periodic staged transfers interspersed with deduplication operations. This periodic approach balances space management requirements with time efficiency by performing deduplication at regular intervals rather than continuously, allowing space to be freed systematically while maintaining overall transfer progress.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The primary storage device performs deduplication operations on its own data between transfer stages, essentially serving its own space management needs. This self-service approach to space creation reduces the need for external intervention and allows the system to manage its own storage constraints efficiently during the restore process.

Inventive Principle:

Principle #25Self-service

3Quantity of substance

If deduplication operations are performed on the primary device during restore, then storage efficiency is improved, but device complexity increases

Engineering Contradiction:

Improvestorage efficiencyVSAvoiddevice complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The restore operation and deduplication operation are merged into a single coordinated process. Rather than treating them as separate operations, the system combines them so that deduplication is initiated and progresses concurrently with the restore operation, sharing resources and coordination mechanisms between the two functions.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The primary storage device is designed to perform multiple functions simultaneously: receiving and storing rehydrated data while also performing deduplication operations on its existing data. This multi-functionality allows the device to improve storage efficiency during the restore process without requiring separate dedicated systems for each operation.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS10339112B1Restoring data in deduplicated storage

Publication Date: 2019.07.02 COHESITY INC

AI summary

Various systems and methods for performing a restore operation. For example, one method involves receiving information identifying a set of data objects to restore. The method also involves dividing the set of data objects into first and second subsets of data objects. After the first one of the subsets of data objects is restored from a backup computing system to a source computing system, the method involves determining whether a deduplication operation is performed on the source computing system. The method also involves delaying restoring the second subset until after the deduplication operation is performed on the source computing device.