Backup Object Segmentation for Incremental-forever Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Block-level incremental-forever backup systems face inefficiencies in data expiration processes, particularly when using sequential-access storage media or media with slow access times, as they require reading and consolidating data, consuming significant resources and limiting scalability.
Innovation Solution
The system divides storage media into logical regions and subregions during full backups, and uses heuristics to determine and copy only changed data during incremental backups, creating backup objects without the need to read from storage, thus optimizing the number of backup objects maintained and tracked for efficient restoration and expiration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If data is read from backup storage and consolidated to expire old backup versions, then expiration can be achieved with granularity of single backup version, but backup server resources are consumed and scalability is limited
Solution Approach 1:
The patent segments the backup version into multiple backup objects, where each backup object represents a discrete unit of data from a specific time period. This segmentation allows the system to track and expire individual backup versions by managing their constituent backup objects, achieving fine-grained expiration control without requiring resource-intensive data consolidation operations.
Solution Approach 2:
The patent performs preliminary actions by creating backup objects during the backup process itself, organizing data into time-based segments before expiration is needed. This preliminary organization enables the system to efficiently determine what can be expired without requiring subsequent data reading and consolidation operations, thereby reducing backup server resource consumption.
2Measurement precision
If periodic full backup versions are created to enable expiration, then backup version expiration can be achieved, but additional storage space, bandwidth, and resources are consumed
Solution Approach 1:
The patent segments the backup timeline into discrete backup objects, each representing data from a specific period. This segmentation eliminates the need for periodic full backups because the system can track individual backup objects and their temporal relationships, enabling expiration decisions based on actual data age rather than requiring complete re-backups.
Solution Approach 2:
The patent changes the parameter of backup version representation from complete full backups to incremental backup objects with temporal metadata. This parameter change allows the system to achieve expiration capability without the resource overhead of periodic full backups, as expiration can be determined by examining backup object timestamps and dependencies rather than restoring and re-backing up entire datasets.
3Adaptability or versatility
If the number of backup objects is increased to maintain finer granularity, then restoration flexibility is improved, but the complexity of tracking and managing backup objects increases
Solution Approach 1:
The patent segments backup data into time-based backup objects with clear temporal boundaries and metadata. This segmentation provides restoration flexibility by allowing selective recovery of specific time periods while managing complexity through consistent temporal organization and metadata tracking, making it easier to identify and manage backup objects compared to non-segmented approaches.
Solution Approach 2:
The patent adds a temporal dimension to backup object organization by incorporating time period metadata and sequential identifiers. This dimensional addition enables the system to manage numerous backup objects efficiently by providing multiple axes for identification and filtering (time period, sequence number, data type), thereby reducing the perceived complexity despite increased granularity.
Data Source
AI summary
Embodiments of the present invention provide a scalable, efficient way to backup data in a block-level incremental-forever backup system such that backup and expiration of data can be achieved at the granularity of a single backup version, without having to read or move data that is stored in backup storage.