Backup Server Object-Based Storage Incremental Backup
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies lack a method for incrementally backing up disk data in a large object-based storage manner, leading to inefficiencies in accessing and managing backup data.
Innovation Solution
A backup processing method that creates deletion logs to identify and migrate valid data from expired backups, allowing for the deletion of expired backups in an object-based storage system, thereby optimizing storage space and access efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If incremental backup is used to reduce data amount, then backup efficiency is improved, but there is no technology for incrementally backing up disk data in large object-based storage manner
Solution Approach 1:
The patent segments backup data into data slices and organizes them as objects in an object-based storage system. Each backup is divided into multiple data slices that can be independently managed, enabling incremental backup operations where only changed slices are identified and backed up in subsequent operations.
Solution Approach 2:
The patent introduces a backup server as an intermediary between the disk data source and the object-based storage system. The backup server manages the complex process of converting disk data into object-based storage format, handling incremental backup logic, and coordinating data migration and deletion operations across the storage system.
2Reliability
If multiple objects are accessed separately, then data retrieval is possible, but access times increase due to multiple access operations
Solution Approach 1:
The patent merges multiple data slices that belong to the same logical backup into a single large object in the object-based storage system. This consolidation allows the backup server to access related data slices through a single object access operation rather than multiple separate accesses, significantly reducing access time while maintaining data integrity.
Solution Approach 2:
The patent changes the organizational dimension of backup data from individual scattered objects to hierarchical large objects containing multiple data slices. This dimensional transformation allows efficient access to related data by navigating within the large object structure rather than making multiple independent object access calls.
3Reliability
If expired backups are retained for data recovery, then data recovery capability is maintained, but storage space is consumed
Solution Approach 1:
The patent implements a mechanism to identify and discard expired backup data that is no longer needed for recovery, while maintaining the capability to recover valid backup data. The system tracks backup expiration status and selectively removes expired data slices from large objects, freeing storage space while preserving data recovery capability for valid backups.
Solution Approach 2:
The patent extracts and removes only the expired or invalid data slices from large objects while retaining valid data slices. This selective extraction approach allows the system to reduce storage consumption by eliminating unnecessary data while maintaining the integrity and recoverability of valid backup data within the same large object structure.
Data Source
AI summary
To manage expired backups in a storage system, a backup server retrieves multiple deletion logs which record invalid data included in one or more expired backups. When a deletion condition is met, the backup server identifies a first large object based on the multiple deletion logs, and sends a data migration request to an object-based storage system to instruct the object-based storage system to copy valid data of the first large object to a second large object. Thereafter, the backup server sends an object deletion request to the object-based storage system to instruct the object-based storage system to delete the first large object, thereby clearing up the expired backups.