Metadata Agent for Granular Backup Restore

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current block-based backup systems for computer data do not efficiently distinguish and update metadata associated with files, requiring time-consuming post-processing and resulting in outdated metadata.

Innovation Solution

A metadata agent is implemented to collect and transmit file metadata and incremental changes in real-time, independently of the backup process, allowing for efficient association with backup metadata and reducing the need for post-processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If post-processing of the backup image is performed to obtain metadata, then metadata can be identified, but the process is time-consuming and resource-intensive

Engineering Contradiction:

Improvemetadata identification accuracyVSAvoidmetadata collection efficiency

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The metadata agent collects metadata in real-time during normal operations before backup is needed, so that when backup or restore operations occur, the metadata is already available and up-to-date, eliminating the need for time-consuming post-processing

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If post-processing of the backup image is performed to obtain metadata, then metadata can be identified, but the metadata is not up-to-date because it is based on a completed backup

Engineering Contradiction:

Improvemetadata accuracyVSAvoidmetadata timeliness

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The metadata agent operates continuously in the background, constantly monitoring and collecting metadata changes as they occur, ensuring that the metadata remains current and reflects the latest state of files without interruption from backup cycles

Inventive Principle:

Principle #20Continuity of useful action

3Productivity

If block-based backup approach is used, then fast backing up of entire volume is enabled, but the backup system does not distinguish data from metadata

Engineering Contradiction:

Improvebackup speedVSAvoidmetadata distinction

Core Design Contradiction:

ProductivityVSLoss of information

Solution Approach 1:

The system separates the metadata collection function from the backup process by deploying an independent metadata agent that specifically targets metadata elements, while the block-based backup continues to handle data blocks efficiently, allowing both functions to operate independently without interference

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS10853184B1Granular restore view using out-of-band continuous metadata collection

Publication Date: 2020.12.01 EMC IP HLDG CO LLC

AI summary

Disclosed are systems and methods for using a metadata agent to collect metadata from a client computer system and including receiving the metadata associated with files used by applications executing in the client computer system. The metadata belong to objects stored in a volume associated with the client computer system. The metadata is collected in real time by the metadata agent executing in the client computer system as a background task. The metadata is stored in a metadata base associated with a metadata server. A request to search the metadata is received from a backup server associated with the metadata server. The search request includes search criteria. A search engine associated with the metadata server searches the metadata in the metadata database to find a match based on the search criteria. A search result is transmitted from the metadata server to the backup server which uses the search result to search for objects in the backup data.