Metadata Map for Differential Backup Processing

Solution Overview

Problem

Conventional differential backup methods, such as inode scans, are inefficient and require significant processing time and storage for large file systems, especially when dealing with numerous files and terabytes of data, due to the need for generating and comparing extensive file lists and storing intermediate files.

Innovation Solution

An information processing apparatus and method that uses a metadata management unit to generate a map indicating the presence or absence of metadata associated with a unique identification value, scanning metadata to detect created, modified, or deleted files, and storing only the necessary metadata and data blocks in a backup storage device, eliminating the need for intermediate files and reducing processing load.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If inode scan with file list comparison is used to detect differential data, then deleted files can be detected, but processing time and storage requirements increase significantly for large file systems

Engineering Contradiction:

Improvedifferential data detection accuracyVSAvoidbackup processing time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts only the essential metadata (inode number, file size, modification time) needed for differential detection, storing it in a compact database structure. This eliminates the need to process and compare complete file lists, reducing processing time while maintaining the ability to detect created, modified, and deleted files through metadata comparison alone

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the approach from comparing file list structures to comparing specific metadata parameters (inode numbers, sizes, modification times) stored in a database. This parameter-based comparison is more efficient for large file systems as it avoids the computational overhead of generating and comparing complete file lists

Inventive Principle:

Principle #35Parameter changes

2Reliability

If complete file lists are generated and compared for differential backup, then all file changes can be detected, but storage capacity for intermediate files increases

Engineering Contradiction:

Improvefile change detection completenessVSAvoidstorage for intermediate files

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential metadata (inode number, file size, modification time) needed for differential detection, storing it in a compact database structure. This eliminates the need to process and compare complete file lists, reducing processing time while maintaining the ability to detect created, modified, and deleted files through metadata comparison alone

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a compact copy of essential file metadata in a database structure that can be efficiently stored and compared. This metadata copy contains sufficient information to detect all file changes without requiring storage of complete file lists, significantly reducing the storage burden for intermediate files

Inventive Principle:

Principle #26Copying

3Reliability

If regular backup of several terabytes is performed, then data redundancy is achieved, but processing load on information processing apparatus increases

Engineering Contradiction:

Improvedata redundancyVSAvoidprocessing load

Core Design Contradiction:

ReliabilityVSPower

Solution Approach 1:

The patent extracts only the essential metadata (inode number, file size, modification time) needed for differential detection, storing it in a compact database structure. This eliminates the need to process and compare complete file lists, reducing processing time while maintaining the ability to detect created, modified, and deleted files through metadata comparison alone

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs only the necessary metadata scanning and comparison operations required for differential backup detection, rather than processing all files completely. This partial action approach focuses computational resources only on identifying changed files, significantly reducing processing load while maintaining backup reliability

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS10705919B2Data backup using metadata mapping

Publication Date: 2020.07.07 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

An information processing apparatus, backup method, and program product that enable efficient differential backup. In one embodiment, an information processing apparatus for files stored in a storage device includes: a metadata management unit for managing metadata of files stored in the storage device; a map generation unit for generating a map which indicates whether metadata associated with an identification value uniquely identifying a file in the storage device is present or absent; and a backup management unit for scanning the metadata to detect files that have been created, modified, or deleted since the last backup, and storing at least a data block and the metadata for a detected file in a backup storage device as backup information in association with the identification value.