Selective File Update in Image Backup via Consistency Monitoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data backup methods, such as full image backups followed by incremental backups, are inefficient for frequently changing files, leading to inconsistent backups and high resource consumption.
Innovation Solution
The system and method for updating select files in an image backup involve performing an image backup, selecting files based on predefined rules, monitoring these files for consistency, and updating the backup only when the files return to a full consistency state.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the frequency of incremental backups is increased to capture frequently changing files, then the backup consistency is improved, but the time consumption and system resource usage increase significantly
Solution Approach 1:
The system performs preliminary actions by monitoring file access patterns and identifying frequently changing files before the backup operation. This allows the system to prepare a targeted backup plan that focuses only on these specific files, rather than performing full incremental backups at high frequency. The file monitoring and identification happens in advance, enabling efficient resource utilization during the actual backup process.
Solution Approach 2:
Instead of applying the same backup frequency and resource allocation to all files, the system applies local quality by differentiating between frequently changing files and static files. Frequently changing files receive enhanced monitoring and targeted backup attention, while static files are backed up using standard incremental procedures. This localized approach optimizes resource usage by concentrating efforts where they are most needed.
2Reliability
If the frequency of incremental backups is increased to capture frequently changing files, then the backup consistency is improved, but the storage space requirement increases significantly
Solution Approach 1:
The system applies local quality by storing backup data differently based on file characteristics. Frequently changing files are monitored and backed up with higher priority and more frequent updates, while static files are stored using standard incremental backup methods. This localized storage strategy reduces overall storage requirements by avoiding redundant backups of files that don't change often.
Solution Approach 2:
The system extracts frequently changing files from the general backup pool and handles them separately with targeted backup procedures. By separating these files and applying specialized backup logic, the system avoids storing multiple versions of static files that would consume excessive storage space, while ensuring adequate protection for the dynamically changing files.
3Device complexity
If VSS snapshots are used for applications not compatible with shadow copy generators, then the backup process is simplified, but the backup consistency deteriorates resulting in crash consistency state
Solution Approach 1:
The system introduces an intermediary file monitoring mechanism that sits between the VSS snapshot process and incompatible applications. This intermediary monitors file access patterns and coordinates with the backup process to ensure files are captured in a consistent state, even for applications that don't play nice with traditional shadow copy generators. The intermediary translates application file operations into backup-friendly formats without requiring changes to the applications themselves.
Solution Approach 2:
The system performs preliminary file monitoring and consistency checks before initiating the VSS snapshot process for incompatible applications. By identifying files that are currently being modified and waiting for them to reach a stable state, the system ensures that the subsequent snapshot captures consistent data. This preliminary action prevents the crash consistency problem that would otherwise occur with incompatible applications.
Data Source
AI summary
Disclosed herein are systems and methods for updating select files in an image backup. In an exemplary aspect, a method comprises performing an image backup of a storage device comprising a plurality of files. The method comprises selecting a file of the plurality of files based on file selection rules and subsequent to the image backup, detecting that the file has exited a full consistency state. The method comprises monitoring the file to detect a return to the full consistency state. In response to detecting that the file has returned to the full consistency state, the method comprises identifying a physical address of at least one sector comprising the file on the storage device, and updating a version of the file previously captured in the image backup with a version of the file after returning to the full consistency state.