Server-Side Group Fingerprints for Virtual Synthesis Deduplication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data deduplication systems face increased processing overhead and limitations in enabling virtual synthetic backups for asset types that lack Change Block Tracking, such as databases, which hinders network bandwidth savings and cyber recovery optimizations.
Innovation Solution
Implementing client-side targeted deduplication using virtual synthesis, where the deduplication backup server manages group fingerprints and allows clients to perform inline deduplication based on server-retrieved fingerprints, enabling virtual synthetic backups without requiring clients to maintain persistent cache storage of group fingerprints.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of substance
If traditional server-side deduplication logic segments and fingerprints all data to be backed up, then storage overhead is reduced, but processing overhead is increased
Solution Approach 1:
The patent segments the deduplication process into two parts: client-side virtual synthesis that creates backup data structures without full processing, and server-side deduplication that handles fingerprinting and deduplication. This segmentation allows the client to avoid heavy processing overhead while the server performs the actual deduplication operations.
Solution Approach 2:
The patent introduces virtual synthesis as an intermediary step between data backup and traditional deduplication. The virtual synthesis process creates a representation of backup data that can be later synthesized on the server, acting as a mediator that reduces the processing burden on both client and server by pre-organizing data structures.
2Loss of energy
If virtual synthetic backups are implemented, then network bandwidth is saved, but asset types lacking Change Block Tracking knowledge cannot take advantage
Solution Approach 1:
The patent makes the backup system universal by implementing virtual synthesis that works with any asset type regardless of whether it supports Change Block Tracking. The server performs the synthesis operation universally for all backup types, allowing databases, files, and other assets to benefit from bandwidth savings without requiring asset-specific intelligence.
Solution Approach 2:
The patent enables self-service virtual synthesis where the server automatically performs the synthesis operation using stored backup data and incremental changes. The system serves itself by maintaining the necessary backup data structures and automatically synthesizing new backups without requiring external intelligence from the backed-up assets.
3Productivity
If clients maintain persistent cache storage of group fingerprints, then deduplication can be performed, but storage requirements on client side increase
Solution Approach 1:
The patent extracts the group fingerprint storage requirement from the client side and places it on the server side. The client only needs to send backup data and receive synthesized results, while the server maintains the persistent cache of group fingerprints needed for deduplication operations. This extraction eliminates client-side storage requirements while preserving deduplication capability.
Solution Approach 2:
The patent shifts the storage dimension from client-side persistent cache to server-side storage. By moving the fingerprint database to the server, the system changes the spatial dimension of where deduplication data resides, allowing clients to perform deduplication operations without maintaining local cache storage.
Data Source
AI summary
Embodiments of a targeted deduplication process that splits protected data into variable size segments, generates a fingerprint for each segment, and then combines fingerprints into groups to form group fingerprints. The group fingerprints are stored on and retrieved from a server by a client to identify duplicate data present on a server during the backup process on an “as needed” basis. The specific group fingerprints sent are based on knowledge of previous backups of the asset, either learned or provided as a hint from the backup application. Once it is known that a specific group fingerprint is present on the server, a virtual synthetic request can be generated instead of a traditional deduplication process. This enables virtual synthetic backups for applications that do not have sufficient knowledge of changed blocks from a previous backup to use the virtual synthetic operations on their own.