Synthetic Full Backup Generation via Distributed Indexing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data backup systems face inefficiencies in resource usage and management due to the need for frequent full backups, which consume significant network bandwidth and complicate data restoration, especially in systems with few changes, leading to longer restore times and increased storage costs.
Innovation Solution
A distributed method for generating a synthetic full backup, where a target computer tracks and stores information to construct a synthetic full backup, allowing for the combination of incremental and full backup images, and delegates the workload to the machine being backed up, thereby distributing processing and network bandwidth more evenly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If full backups are performed frequently, then data integrity and restore capability are improved, but network bandwidth consumption and storage costs increase
Solution Approach 1:
The system performs preliminary actions by maintaining file identifier information and backup images during incremental backups. This pre-prepared data enables synthetic full backups to be constructed later without requiring actual full backup operations, thus preserving data integrity while avoiding repeated high-bandwidth full backup transmissions.
Solution Approach 2:
The patent creates synthetic copies of full backup images by combining incremental backup images and file identifier information. These synthetic full backup images are indistinguishable from actual full backups but are generated through data synthesis rather than complete data transmission, significantly reducing network bandwidth consumption while maintaining restore capability.
2Quantity of substance
If incremental backups are used to reduce storage requirements, then storage efficiency is improved, but restore complexity and time increase
Solution Approach 1:
The patent introduces file identifier information as an intermediary element that bridges incremental backup images. This intermediary data structure enables the system to efficiently locate and combine relevant files from multiple incremental backups to reconstruct full backup images, thereby simplifying the restore process while maintaining storage efficiency.
Solution Approach 2:
The system performs preliminary organization of backup data by maintaining file identifier information that maps files to their locations in incremental backup images. This pre-organization enables efficient restore operations by allowing the system to quickly locate and assemble required files without complex searching or analysis of incremental backup sequences.
3Ease of operation
If full backups are centralized on backup servers, then restore operations are simplified, but workload distribution and network efficiency worsen
Solution Approach 1:
The patent segments the full backup creation process into two parts: (1) maintaining file identifier information and incremental backup images distributed across the network, and (2) synthesizing full backup images on-demand when needed. This segmentation allows restore operations to access locally cached synthetic full backups, simplifying operations while distributing workload and reducing repeated network transmissions.
Solution Approach 2:
The system performs preliminary distribution of file identifier information and incremental backup images to appropriate locations in the network. This pre-distribution enables synthetic full backups to be constructed locally when needed, reducing the need for repeated full backup transmissions across the network while maintaining the ability to simplify restore operations.
Data Source
AI summary
System and method for generating a synthetic full backup. A request to perform an incremental backup may be received at a target computer. The incremental backup may be performed on the target computer in response to the request. The target computer may maintain information identifying files that are encountered in the incremental backup. The information may be configured to be used to construct a synthetic full backup. A request to perform a synthetic full backup may be received. The information may be requested. The synthetic full backup may be constructed using the information from the target computer. A synthetic full backup index may be constructed for the synthetic full backup using records from old indexes for each file in the synthetic full backup. The synthetic full backup may be transferred to a backup image. The synthetic full backup index may be stored.