Virtual Machine Metadata Extraction for Backup Efficiency

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional systems face inefficiencies in identifying changed virtual machine content files between backups due to the time-consuming and resource-intensive process of reading entire virtual machine versions, especially for large data sets like 100 TB, and relying on metadata comparison which is also resource-intensive.

Innovation Solution

The implementation of a tree data structure, specifically a snapshot tree and file metadata trees, allows for efficient identification of changed content files by analyzing file offsets and metadata associations, reducing the need to read extensive metadata by focusing on changed metadata chunks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional systems read the entire contents of virtual machine versions to determine differences, then complete accuracy in identifying changed files is achieved, but the process becomes time consuming and resource intensive

Engineering Contradiction:

Improveaccuracy in identifying changed filesVSAvoidtime to identify changed files

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts and utilizes metadata (timestamps, file offsets, content hashes) from virtual machine versions to identify changed files without reading the entire file contents. This extraction approach maintains accuracy while dramatically reducing the time and resources required compared to conventional full-content comparison methods

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary indexing of metadata (timestamps, content hashes, file offsets) during the backup process. This preliminary action enables rapid change detection in subsequent operations by having the metadata readily available for comparison, eliminating the need to read entire file contents when identifying changes

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If systems read through all metadata associated with virtual machine volumes to determine changed files, then complete identification of changed content files is achieved, but the process remains time consuming and resource intensive for large volumes

Engineering Contradiction:

Improvecompleteness in identifying changed filesVSAvoidspeed of metadata processing

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The patent applies partial action by comparing only the necessary metadata elements (timestamps, content hashes, file offsets) rather than processing all metadata. This selective approach achieves complete identification of changed files while significantly reducing processing time and resource consumption for large virtual machine volumes

Inventive Principle:

Principle #16Partial or excessive action

Solution Approach 2:

The system segments the metadata comparison process into discrete elements (timestamps, content hashes, file offsets) that can be independently compared. This segmentation enables efficient processing by focusing only on the specific metadata components needed to identify file changes, rather than processing metadata as a monolithic block

Inventive Principle:

Principle #1Segmentation

3Adaptability or versatility

If the storage system stores multiple versions of virtual machines with different content files, then version recovery capability is improved, but the complexity of tracking and identifying changes between versions increases

Engineering Contradiction:

Improveversion recovery capabilityVSAvoidcomplexity of tracking changes

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces metadata (timestamps, content hashes, file offsets) as an intermediary layer between virtual machine versions. This intermediary enables automatic and accurate tracking of changes across multiple versions without requiring complex manual tracking mechanisms, thereby improving version recovery capability while managing complexity through structured metadata comparison

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11782886B2Incremental virtual machine metadata extraction

Publication Date: 2023.10.10 COHESITY INC

AI summary

A virtual machine container file is analyzed to determine which portion of the virtual machine container file corresponds to a virtual machine file system metadata of the virtual machine container file. One or more differences between a first version of a virtual machine container file and a second version of the virtual machine container file are determined at least in part by traversing a snapshot structure associated with the virtual machine container file. The determined one or more differences that corresponds to the virtual machine file system metadata portion of the virtual machine container file are identified based at least in part on the analysis of the virtual machine container file. The identified one or more differences corresponding to the virtual machine file system metadata portion of the virtual machine file are utilized to identify one or more changes from the content files included in the first version of the virtual machine container file to content files included in the second version of the virtual machine container file.