Backup Storage Optimization via Data Chunk Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data protection systems face inefficiencies in managing user data backups, particularly in transferring data chunks associated with deleted users and unchanged data blocks, which leads to excessive storage usage and computational burdens in backup storage.
Innovation Solution
A system that performs smart archive backup operations, proactively transferring user data backups of deleted users and unchanged data chunks from backup storage to archive storage based on retention periods and archive values, optimizing storage without violating protection policies.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all user data chunks are stored in backup storage, then data restoration capability is maintained, but storage space is excessively consumed
Solution Approach 1:
The patent segments user data into individual data chunks and applies different storage strategies to different chunks. Immutable data chunks (unchanged for a specified period) are separated from mutable chunks and stored in archive storage, while mutable chunks remain in backup storage. This segmentation allows the system to maintain restoration capability for necessary data while reducing overall backup storage consumption.
Solution Approach 2:
The patent applies different storage quality characteristics to different data chunks based on their immutability status. Archive storage provides long-term retention with lower cost, while backup storage provides frequent access with higher performance. By matching storage quality to data characteristics locally, the system optimizes both cost and restoration capability.
2Quantity of substance
If manual transfer of unchanged data chunks to archive storage is performed, then storage optimization is achieved, but operational complexity increases
Solution Approach 1:
The patent implements a self-service mechanism where the backup system automatically identifies unchanged data chunks by comparing current backups with previous versions, determines which chunks are eligible for archiving based on the specified period, and transfers them to archive storage without manual intervention. This automation eliminates operational complexity while achieving storage optimization.
Solution Approach 2:
The system continuously monitors data chunk changes by comparing successive backups and uses this feedback to automatically determine when data becomes immutable. This feedback loop enables the system to dynamically adjust archiving decisions based on actual data stability, removing the need for manual assessment.
3Reliability
If data retention period is extended, then data protection is improved, but storage costs increase
Solution Approach 1:
The patent implements a dynamic storage strategy where data chunks transition from backup storage to archive storage based on their age and immutability status. This dynamic approach allows the system to extend effective retention by moving older immutable data to archive storage, thereby maintaining data protection over extended periods while managing storage costs through differentiated storage tiers.
Data Source
AI summary
A system for providing data protection services for user data generated by an application includes persistent storage that includes an archive storage and a backup storage. The system also includes a manager. The manager is programmed to generate data chunks using user data, generate backup object metadata associated with the data chunks; obtain previously generated backup object metadata associated with the user data using an archive value, make a first determination that at least one data chunk of the data chunks is to be archived using the backup object metadata and the previously generated backup object metadata, and, in response to the first determination: store the at least one data chunk in the archive storage as a portion of a user data backup, and store remaining data chunks of the data chunks in the backup storage as the remaining portion of the user data backup.