Precalculating Client-Side Deduplication Signatures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Client-side data deduplication performance is negatively impacted by the computational overhead of calculating signatures for data objects, particularly during backup operations when system resource utilization is high.
Innovation Solution
Precalculating deduplication signatures for data objects before the start of a backup operation, especially when system resource usage is below a threshold, and delaying signature recalculations for frequently modified objects until the backup window, thereby reducing unnecessary resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If signatures are calculated during backup operations, then data deduplication functionality is achieved, but client performance is negatively impacted due to high computational overhead
Solution Approach 1:
The patent applies preliminary action by calculating data object signatures before the backup operation begins, during periods of low system resource usage. This allows the deduplication process to use pre-computed signatures during the backup window, eliminating the computational overhead from the critical backup path and thus improving client performance while maintaining deduplication functionality.
2Measurement precision
If signatures are recalculated for frequently modified data objects, then signature accuracy is maintained, but system resources are unnecessarily consumed
Solution Approach 1:
The patent applies partial action by selectively recalculating signatures only for data objects that are modified during the backup window, rather than recalculating all signatures. The system monitors modifications and triggers signature recalculation only when necessary, thus maintaining signature accuracy for backed-up data while avoiding unnecessary computational resource consumption.
3Reliability
If signature calculation is performed continuously, then up-to-date signatures are available, but system performance degrades during high-activity periods
Solution Approach 1:
The patent applies dynamics by making the signature calculation process adaptive to system conditions. The system dynamically switches between pre-calculation mode (during low-activity periods) and on-demand recalculation mode (during backup operations), adjusting its behavior based on system resource availability and backup requirements to maintain both reliability and performance.
Data Source
AI summary
Various systems and methods precalculate client-side deduplication signatures. For example, one method can identify a data object to be included in a backup and then calculate a signature of a data object prior to the start of a backup operation to create the backup. The signature identifies the data object within a deduplicated data store configured to store a backup of the data object. The signature can be calculated in response to detecting that a current usage level of system resources (e.g., such as a current processor utilization) of a client computing device is less than a threshold usage level.