Incremental Data Backup via File Segmentation and Thresholding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data backup methods in distributed databases are time-consuming and resource-intensive, particularly in terms of network and magnetic disk usage, due to the need to back up entire data sets rather than incremental changes.
Innovation Solution
A data backup method and system that records a data backup time point to identify incremental data, allowing for the combination of storage files and performing incremental backups only on files generated after that time point, thereby reducing the need to read and back up entire tables and minimizing resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If full data backup is performed on entire data sets, then data reliability is ensured, but backup time and resource consumption increase significantly
Solution Approach 1:
The patent segments the backup process into full backup and incremental backup phases. Full backup is performed on the entire data set at a demarcation time point, while subsequent backups only segment and back up the specific storage files modified after the last backup, thus reducing backup time while maintaining data reliability
Solution Approach 2:
Instead of performing excessive full backups every time, the patent applies partial action by backing up only the necessary incremental portions (storage files modified after the last backup) when the quantity of modified files reaches a threshold, thereby reducing overall backup time while ensuring data reliability
2Reliability
If full data backup is performed on entire data sets, then complete data protection is achieved, but network and magnetic disk resource consumption increase
Solution Approach 1:
The backup data is segmented into full backup data and incremental backup data. Only the incremental portions (specific storage files modified after last backup) are transmitted and stored, significantly reducing network and magnetic disk resource consumption while maintaining complete data protection capability
Solution Approach 2:
The patent extracts only the necessary incremental data (storage files modified after the last backup) from the entire data set for backup operations. This extraction approach reduces the volume of data requiring network transmission and magnetic disk storage, thereby reducing resource consumption while ensuring data protection
3Productivity
If incremental backup is implemented without file combination, then backup efficiency improves, but data management complexity increases
Solution Approach 1:
The patent combines multiple incremental storage files into a unified incremental backup structure managed through demarcation time points. This merging approach maintains backup efficiency by focusing on incremental data while reducing management complexity through structured organization based on full backup demarcation points
Data Source
AI summary
A data backup method and a data processing system are provided. The method includes: when a quantity of storage files stored in a storage medium meets a preset threshold, acquiring storage files which are stored in the storage medium after a time point, where the time point is a time of previously backing up storage files in the storage medium; combining the storage files after the time point to obtain at least one new storage file; and backing up the at least one new storage file. Therefore, incremental backup is performed on the storage files after the time point.