Snapshot Analysis System for Block Device Data Restoration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In computing environments where full backups are infrequent or incremental backups are frequent, the number of backups to maintain and storage space required becomes large, making data restoration and rollback processes time-consuming due to the need to traverse numerous backups sequentially.

Innovation Solution

A snapshot analysis system that analyzes, models, and clusters snapshots of block devices, using components like an ingestor, block device analyzer, and clustering analyzer to generate structured information and expose snapshots as familiar block devices, allowing for efficient data operations without retrieving the entire block device, utilizing a snapshot block device emulator to provide differential data and facilitate data operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If incremental backups are performed frequently to maintain data integrity, then data protection is improved, but the number of backups to maintain and storage space required becomes large

Engineering Contradiction:
Improvedata protectionVSAvoidnumber of backups
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system segments backup data into snapshots that capture only changed blocks rather than complete data copies. Each snapshot is divided into block-level changes, allowing selective storage and retrieval of only modified portions, thereby reducing the quantity of backup data while maintaining data protection.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the differential data (changed blocks) from complete backup operations. By taking out only the necessary changed portions rather than entire datasets, the system reduces storage requirements while preserving the ability to restore data to any previous state.

Inventive Principle:
Principle #2Taking out (Extraction)

2Quantity of substance

If the number of backups is reduced to save storage space, then storage requirements are improved, but data restoration becomes slower due to fewer backup options

Engineering Contradiction:
Improvestorage spaceVSAvoidrestoration time
Core Design Contradiction:
Quantity of substanceVSLoss of time

Solution Approach 1:

The system performs preliminary indexing and modeling of snapshot data structures before restoration is needed. By pre-processing and organizing backup metadata, the system enables rapid location and retrieval of required data blocks during restoration operations, reducing restoration time despite storing fewer complete backups.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary layer of snapshot metadata and block mapping that mediates between the reduced backup storage and the full data restoration requirement. This intermediary structure allows the system to quickly determine which blocks need to be retrieved and reassemble complete data without traversing through numerous backup files.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If sequential traversal of numerous backups is performed for data restoration, then data can be restored to any state, but the process becomes very time-consuming

Engineering Contradiction:
Improverestoration flexibilityVSAvoidrestoration time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system dynamically queries and filters snapshot data based on the specific restoration requirements rather than performing sequential traversal. The block-level indexing allows the system to adaptively select only the necessary snapshots and blocks, transforming the static sequential process into a dynamic targeted retrieval operation that maintains restoration flexibility while significantly reducing time.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent replaces the mechanical sequential traversal process with a data-driven query system using indexed metadata and block mappings. Instead of mechanically reading through backups in order, the system uses structured information to directly locate and retrieve required data blocks, substituting sequential mechanical operations with intelligent data-driven retrieval.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10019180B1Snapshot data operation request processing
Publication Date: 2018.07.10 AMAZON TECH INC
  • US10019180B1 patent drawing
  • US10019180B1 patent drawing
  • US10019180B1 patent drawing

AI summary

A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.