Incremental Restore for Object-Based Snapshots

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud computing systems face inefficiencies in data restore operations due to the high data transfer requirements of object-based snapshots, which can lead to significant delays and resource constraints, especially in disaster recovery scenarios where only full snapshot restores are supported.

Innovation Solution

Implementing incremental restore operations for object-based snapshots, where only the modified blocks between a source and target snapshot are retrieved and applied, reducing the data transfer needed and enabling faster restore times by utilizing existing volumes with faster read speeds and network connections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If full snapshot restore operations are performed using object-based snapshots, then data resiliency and backup completeness are ensured, but data transfer time and system resource consumption increase significantly

Engineering Contradiction:
Improvedata resiliencyVSAvoiddata transfer time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the restore operation into two phases: (1) immediate restoration of unchanged data blocks from the source volume, and (2) subsequent restoration of only the changed data blocks from the snapshot. This segmentation allows the system to avoid transferring entire volumes while maintaining complete data recovery capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary identification of changed data blocks between the source snapshot and target snapshot before initiating the restore operation. By pre-determining which blocks require transfer, the system minimizes unnecessary data movement and accelerates the restore process while ensuring data完整性.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If full snapshot restore operations are performed, then complete data recovery is achieved, but cloud service productivity and resource utilization deteriorate due to extensive data transfer requirements

Engineering Contradiction:
Improvedata recovery completenessVSAvoidcloud service productivity
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts only the essential changed data blocks from the snapshot for transfer, separating them from the unchanged blocks that can be restored directly from the source volume. This extraction approach maintains complete data recovery capability while dramatically reducing the amount of data that requires network transfer and processing.

Inventive Principle:
Principle #2Taking out (Extraction)

3Loss of time

If incremental restore operations are implemented, then data transfer time and resource consumption are reduced, but system complexity increases due to change detection and selective restoration mechanisms

Engineering Contradiction:
Improverestore operation timeVSAvoidrestore operation complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent introduces a snapshot service as an intermediary component that manages the complex tasks of change detection, block identification, and coordinated restoration. This intermediary abstracts the complexity from the restore operation, providing a simplified interface while handling the intricate logic of incremental restoration in the background.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11544156B1Incremental restore for volumes using object-based snapshots
Publication Date: 2023.01.03 AMAZON TECH INC
  • US11544156B1 patent drawing
  • US11544156B1 patent drawing
  • US11544156B1 patent drawing

AI summary

Systems and methods are provided for conducting incremental restore operations on block storage volumes using an object-based snapshot. A full restore from an object-based snapshot can include copying all blocks of a data set from the object-based snapshot to a destination volume. For high capacity volumes, full restores may take large amounts of time. Moreover, full restores may be inefficient where a destination volume already contains some data of the snapshot. Embodiments of the present disclosure provide for incremental restore operations, where a delta data set is transferred from the snapshot to the destination volume, representing data in the snapshot is not known to already exist on the volume or another available volume.