Block-Based Backup for Volumes Exceeding 64 TB
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current block-based backup systems are limited to supporting volumes up to 64 TB, forcing them to revert to file-level backups for larger volumes, which are less efficient and less effective.
Innovation Solution
The proposed solution involves partitioning large volumes into 64 TB sub-volumes, using the VHDx format to create and manage these sub-volumes, and employing a backup management process that handles full and incremental backups by dividing the volume into 64 TB segments, allowing for efficient backup and recovery of volumes greater than 64 TB by linking parent and child VHDx files.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If block-based backup is used for volumes greater than 64 TB, then backup performance and efficiency are improved, but the system cannot support volumes larger than 64 TB due to VHDx format limitations
Solution Approach 1:
The patent divides a large volume greater than 64 TB into multiple smaller sub-volumes, each within the 64 TB limit. Each sub-volume is backed up as a separate VHDx container, allowing the system to handle volumes larger than the native VHDx limit while maintaining block-based backup performance. The segmentation enables the backup system to process large volumes in manageable chunks without reverting to slower file-level backups.
2Adaptability or versatility
If file-level backup is used for volumes greater than 64 TB, then volume size limitation is avoided, but backup speed and performance deteriorate
Solution Approach 1:
By segmenting the large volume into multiple sub-volumes that fit within VHDx limits, the system maintains block-based backup operations for each segment. This approach preserves the high backup speed characteristic of block-based backups while achieving support for volumes greater than 64 TB through the combined capacity of multiple segmented backups.
3Reliability
If VHDx container size is limited to 64 TB, then system stability and compatibility are maintained, but the system cannot accommodate growing storage requirements
Solution Approach 1:
The patent maintains VHDx container size within the stable 64 TB limit by segmenting larger volumes into multiple sub-volumes. Each VHDx container remains within the proven stability range, while the overall system achieves unlimited storage capacity by combining multiple segmented containers. This approach preserves system reliability while adapting to growing storage requirements.
Solution Approach 2:
The backup system achieves multi-functionality by combining multiple VHDx containers to represent a single logical volume. Each container maintains its individual 64 TB limit for stability, while the aggregate system provides universal support for volumes of any size, making the backup solution adaptable to both small and extremely large storage requirements.
Data Source
AI summary
Embodiments are directed to a method of performing block based backups for large-scale source volumes, by obtaining a total source volume size to determine if the source volume exceeds 64 TB, creating a number of sub-volumes to divide the total source volume into discrete sub-volumes of 64 TB each, and storing in an advanced file type device (AFTD), upon a read operation for a block based backup operation, each block of the source volume into a corresponding sub-volume of the sub-volumes. The method determines a block number and offset of each block and derives the corresponding sub-volume from the offset. Each sub-volume represents an individual saveset of the backup operation, and the container manages the individual saveset for the block based backup operation.