Index File Verification Using Pre-calculated Hash Values

Solution Overview

Problem

Conventional backup file systems face inefficiencies in verifying index files, leading to long processing times and high resource consumption due to the need to check each index entry for correctness, which affects data storage and retrieval efficiency.

Innovation Solution

A method is introduced that determines first verification information for data blocks, creates index entries with second verification information, and uses historical verification information to generate third verification information for the index file, allowing for quick and accurate verification of the index file's correctness and storage location.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional backup file systems verify each index entry individually for correctness, then verification accuracy is improved, but processing time and resource consumption increase significantly

Engineering Contradiction:

Improveverification accuracyVSAvoidprocessing time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing verification information (hash values) for each index entry when the index file is created or updated. This verification information is stored alongside the index entries in the same index file. During verification operations, the system directly compares the stored verification information with newly calculated verification information, eliminating the need for time-consuming individual entry verification and enabling rapid index file verification while maintaining accuracy.

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If conventional backup file systems verify each index entry individually for correctness, then verification accuracy is improved, but computing resource consumption increases significantly

Engineering Contradiction:

Improveverification accuracyVSAvoidcomputing resource consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing verification information (hash values) for each index entry when the index file is created or updated. This verification information is stored alongside the index entries in the same index file. During verification operations, the system directly compares the stored verification information with newly calculated verification information, eliminating the need for time-consuming individual entry verification and enabling rapid index file verification while maintaining accuracy.

Inventive Principle:

Principle #10Preliminary action

3Quantity of substance

If the index file stores only index entries without pre-calculated verification information, then storage efficiency is improved, but verification speed decreases

Engineering Contradiction:

Improvestorage efficiencyVSAvoidverification speed

Core Design Contradiction:

Quantity of substanceVSSpeed

Solution Approach 1:

The patent applies merging by combining the index entries and their corresponding verification information (hash values) into a single integrated index file structure. Each index entry is paired with its verification information in the same data structure, allowing both to be stored and retrieved together. This merging eliminates the need for separate verification data storage while enabling rapid verification by directly comparing stored hash values with newly calculated ones, thus improving verification speed without significantly impacting storage efficiency.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS11513947B2Method, device and computer program product for building and verifying index file

Publication Date: 2022.11.29 EMC IP HLDG CO LLC

AI summary

Embodiments of the present disclosure relate to establishing and verifying an index file. The method for establishing an index file includes: in response to receiving a data block to be stored, determining first verification information for verifying the data block and a first storage address for storing the data block. This method further includes: based on the first verification information, determining an index entry for the data block and a second storage address for storing the index entry, wherein the index entry includes the first verification information and the first storage address, and the index entry will be included in the index file. This method further includes: based on the index entry and the second storage address, determining second verification information. This method further includes: based on the second verification information and historical verification information for the index file, determining third verification information for verifying the index file.