Snapshot Consolidation via Partitioned Patch Hard Links
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data management systems face challenges in efficiently consolidating snapshots stored in partitioned patch files, particularly in managing overlapping data parts and optimizing storage space.
Innovation Solution
A method is introduced to consolidate snapshots by receiving a request to combine a first snapshot with a second snapshot into a third snapshot, comparing data parts to identify overlaps, hard-linking overlapping data parts into the third snapshot, and storing it in a backup file.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If snapshots are stored in separate backup files, then data integrity and version control are maintained, but storage space is wasted due to redundant data
Solution Approach 1:
The patent merges multiple snapshot backup files into a single consolidated backup file by identifying and hard-linking overlapping data parts. This combining approach maintains data integrity through hard links while reducing storage space by eliminating redundant data copies.
Solution Approach 2:
The patent segments backup files into distinct data parts that can be independently compared and hard-linked. By dividing the backup file structure into manageable segments, the system can efficiently identify overlaps and create hard links without processing entire files, thus maintaining reliability while optimizing storage.
2Reliability
If all data parts are copied during consolidation, then complete snapshot data is preserved, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary actions by comparing data parts and identifying overlaps before actual consolidation. By pre-processing to detect redundant data and establish hard link relationships in advance, the system ensures data completeness is maintained while minimizing the time required for the actual consolidation operation.
Solution Approach 2:
The patent extracts only the necessary hard link relationships from overlapping data parts rather than copying all data. This extraction approach preserves complete snapshot data through hard links while significantly reducing processing time and computational resource requirements compared to full data copying.
3Device complexity
If snapshot consolidation is performed without partitioning, then simplicity is maintained, but storage optimization and data management efficiency decrease
Solution Approach 1:
The patent introduces partitioning of backup files into data parts, which initially appears to increase complexity. However, this segmentation enables efficient storage optimization by allowing targeted hard-linking of overlapping portions, ultimately improving data management efficiency through reduced storage requirements and faster consolidation operations.
Data Source
AI summary
A method of consolidating snapshots includes receiving a request to consolidate a first snapshot with a second snapshot into a third snapshot, the first and second snapshots stored in separate backup files, each backup file organized as a directory where data parts of the first and second snapshots can be hard linked to locations outside of the backup file, comparing the data parts of the first and second snapshots to determine if any second snapshot data part fully overlaps with any first snapshot data part, responsive to determining that a second snapshot data part fully overlaps with a first snapshot data part, hard linking the determined second snapshot data part into the third snapshot, and storing the third snapshot in the backup file.