Backup Server Differential Bitmap Valid Data Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data backup methods based on fixed-length volume files result in the transmission of unnecessary data, increasing backup time and storage space usage, as they backup entire fixed-length data blocks even if only a portion of the data is valid, and inefficiently handle thinly configured volumes by writing and restoring invalid data.
Innovation Solution
A method and apparatus that utilize differential bitmaps to identify and transmit only valid data, reducing data transmission and storage space by saving valid data in separate files and maintaining associations through volume mapping files, thereby optimizing backup and restoration processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If fixed-length volume files are used for backup, then data structure simplicity is improved, but data transmission efficiency deteriorates due to transmission of unnecessary invalid data
Solution Approach 1:
The volume is divided into multiple fixed-length data blocks, and each data block is further divided into multiple pieces of data with different granularities. A bitmap is generated for each data block to track which pieces of data have changed, enabling selective backup of only the changed pieces rather than the entire fixed-length block.
Solution Approach 2:
The patent extracts only the valid changed data from the fixed-length data blocks based on the bitmap information. Instead of backing up entire fixed-length blocks, the system identifies and extracts only the specific pieces of data that have changed, eliminating the transmission of unnecessary invalid data.
2Reliability
If entire fixed-length data blocks are backed up, then data integrity is improved, but storage space consumption deteriorates due to saving of invalid data
Solution Approach 1:
The backup system segments the fixed-length data blocks into multiple pieces of data and uses bitmaps to track changes at the piece level. This allows the system to maintain data integrity by accurately tracking which pieces have changed while storing only those specific pieces rather than entire blocks.
Solution Approach 2:
The patent applies different treatment to different parts of the data structure. Valid changed data is stored in detail with full integrity, while invalid unchanged data is represented efficiently through bitmap markers without occupying full storage space, optimizing the local quality of storage for each data piece.
3Ease of manufacture
If fixed-length volume files are used for backup, then implementation simplicity is improved, but restoration efficiency deteriorates due to restoration of invalid data
Solution Approach 1:
The restoration process uses the bitmap information to identify which specific pieces of data need to be restored from each fixed-length data block. This segmented approach allows the restoration system to skip invalid unchanged data and directly restore only the valid changed pieces, improving restoration efficiency while maintaining implementation simplicity.
4Productivity
If differential bitmaps are used to track changes, then data transmission efficiency is improved, but processing complexity deteriorates
Solution Approach 1:
The bitmap is segmented to correspond with the divided data blocks and pieces of data. This segmentation allows the system to generate and process bitmap information in manageable units that match the data structure, reducing processing complexity while maintaining the efficiency benefits of differential tracking.
Solution Approach 2:
The patent uses bitmap copies to represent the state of data blocks. Instead of complex processing of entire data blocks to identify changes, the system uses simplified bitmap copies that can be efficiently generated, compared, and processed to determine which data pieces have changed.
Data Source
Figure 1~3
Figure 4~6
Figure 7~9
AI summary
This application discloses a data backup method and apparatus, a data restoration method and apparatus, and a server. The backup method includes the following steps: obtaining, by a backup server, an original differential bitmap of a first target volume from a production end; obtaining valid data in each fixed-length data block from the first target volume according to the original differential bitmap; saving a bitmap corresponding to a fixed-length data block including the valid data to a fixed-length volume bitmap file of the fixed-length data block according to the original differential bitmap, where the fixed-length volume bitmap file is used to identify a storage address of the valid data; and saving the valid data in the fixed-length data block to a fixed-length volume file of the fixed-length data block. According to the foregoing solution, only valid data is transmitted, an amount of data transmitted between the production end and the server can be reduced, a transmission speed can be increased, and storage space can be saved.