Fingerprint Cache Initialization for Data Deduplication

Solution Overview

Problem

Existing data deduplication techniques require significant computing resources and bandwidth, especially for large data storage systems, due to the need for full initialization of client-side fingerprint caches, which can be resource-intensive and inefficient.

Innovation Solution

The method involves leveraging a client-side fingerprint cache associated with a previous storage of data to initialize a new cache, by detecting changes, updating, or verifying fingerprints, thereby reducing the need for full cache initialization and minimizing resource usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If full initialization of client-side fingerprint cache is performed, then data deduplication accuracy is improved, but computing resources and bandwidth consumption increase significantly

Engineering Contradiction:

Improvedata deduplication accuracyVSAvoidcomputing resources consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by maintaining and updating the fingerprint cache continuously between backup operations. The cache is updated with fingerprints of modified files and deleted from the cache when files are removed, so that when a backup occurs, the cache already contains relevant fingerprint information, eliminating the need for full re-initialization.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system uses a copy of the fingerprint cache (the client-side cache) to store fingerprint information locally. Instead of repeatedly querying the server for complete fingerprint data, the client maintains a local copy that is updated incrementally, reducing bandwidth consumption and computing resources required for each backup operation.

Inventive Principle:

Principle #26Copying

2Reliability

If full initialization of client-side fingerprint cache is performed, then data deduplication accuracy is improved, but network bandwidth consumption increases

Engineering Contradiction:

Improvedata deduplication accuracyVSAvoidnetwork bandwidth

Core Design Contradiction:

ReliabilityVSLoss of substance

Solution Approach 1:

The system performs preliminary actions by maintaining and updating the fingerprint cache continuously between backup operations. The cache is updated with fingerprints of modified files and deleted from the cache when files are removed, so that when a backup occurs, the cache already contains relevant fingerprint information, eliminating the need for full re-initialization.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system uses a copy of the fingerprint cache (the client-side cache) to store fingerprint information locally. Instead of repeatedly querying the server for complete fingerprint data, the client maintains a local copy that is updated incrementally, reducing bandwidth consumption and computing resources required for each backup operation.

Inventive Principle:

Principle #26Copying

3Measurement precision

If numerous queries are transmitted for cache initialization, then fingerprint accuracy is improved, but processing time and system complexity increase

Engineering Contradiction:

Improvefingerprint accuracyVSAvoidcache initialization time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by maintaining and updating the fingerprint cache continuously between backup operations. The cache is updated with fingerprints of modified files and deleted from the cache when files are removed, so that when a backup occurs, the cache already contains relevant fingerprint information, eliminating the need for full re-initialization.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where the client sends notifications to the server about file modifications and deletions. The server responds by updating the client's cache accordingly, creating a feedback loop that keeps the cache synchronized with actual file system changes without requiring full re-initialization.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS8060715B2Systems and methods for controlling initialization of a fingerprint cache for data deduplication

Publication Date: 2011.11.15 COHESITY INC

AI summary

A computer-implemented method for controlling initialization of a fingerprint cache for data deduplication associated with a single-instance-storage computing subsystem may comprise: 1) detecting a request to store a data selection to the single-instance-storage computing subsystem, 2) leveraging a client-side fingerprint cache associated with a previous storage of the data selection to the single-instance-storage computing subsystem to initialize a new client-side fingerprint cache, and 3) utilizing the new client-side fingerprint cache for data deduplication associated with the request to store the data selection to the single-instance-storage computing subsystem. Other exemplary methods of controlling initialization of a fingerprint cache for data deduplication, as well as corresponding exemplary systems and computer-readable-storage media, are also disclosed.