Snapshot Difference Report Consolidation for Backup Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Storage devices, such as large-scale distributed file systems, face inefficiencies due to the accumulation of redundant backup data, which occupies valuable storage space, despite being designed for fault tolerance.
Innovation Solution
A method involving the generation of snapshot difference reports between two snapshots of data, allowing for the deletion of older snapshots and consolidation of multiple reports into a single report, thereby reducing storage space usage by eliminating redundant data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If backup features are implemented to ensure fault tolerance, then reliability is improved, but storage space is consumed by redundant backup data
Solution Approach 1:
Multiple snapshot difference reports are merged into a single consolidated report that contains the union of all changes across multiple snapshots. This consolidation eliminates redundant data while preserving the fault tolerance capability, as the target device can still recover data from the consolidated report without needing to store multiple separate reports.
Solution Approach 2:
Source device snapshots are discarded after their difference reports have been transmitted to the target device, but the ability to recover data is maintained through the consolidated difference reports stored at the target device. This allows the source device to free up storage space while the target device retains the necessary information for data recovery.
2Reliability
If multiple snapshot difference reports are stored to preserve backup history, then reliability is improved, but device complexity increases
Solution Approach 1:
Multiple snapshot difference reports are merged into a single consolidated report that captures all changes across the snapshot series. This merging process simplifies the target device's storage and management requirements while maintaining complete backup history, as the consolidated report contains the union of all changes without requiring separate storage for each individual report.
3Reliability
If snapshots are retained for extended periods to ensure data recovery capability, then reliability is improved, but productivity decreases due to increased storage overhead
Solution Approach 1:
The essential recovery information is extracted from multiple snapshots and consolidated into a single difference report that contains only the necessary change data. This extracted information is sufficient for data recovery purposes, allowing the source device to delete original snapshots and improve storage efficiency while the target device maintains the consolidated report for recovery operations.
Solution Approach 2:
Source device snapshots are discarded after transmitting their difference information to the target device, but data recovery capability is preserved through the consolidated difference reports stored at the target device. This approach improves storage efficiency at the source while maintaining the ability to recover data when needed.
Data Source
AI summary
A method for data consolidation and preservation during backups of data stored in a source device from the source device to a target device is provided. The method is executed by the source device and includes: obtaining a first snapshot of the data and a second snapshot of the data; generating, in response to the obtaining, a first snapshot difference report using the first snapshot and the second snapshot; transmitting, in response to generating the first snapshot difference report, the first snapshot difference report to the target device to be stored with a backup copy of the data; and deleting, in response to transmitting the first snapshot difference report, the first snapshot.