Source Volume Backup with Predictive Lookahead Optimizations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current backup systems face performance issues when copying large data volumes, particularly when the operating system is actively writing to the source volume, as they require entering copy-on-write mode, which can impact system performance and lead to increased storage needs for the CoW file, potentially causing failures due to insufficient storage allocation.
Innovation Solution
The system employs a method that designates blocks to be copied from the source volume to the target volume while the operating system is writing, enters copy-on-write mode only when necessary, and uses predictive and lookahead optimizations to reduce the time spent in copy-on-write mode, thereby improving system responsiveness and reducing storage requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If copy-on-write mode is entered to copy large data volumes while the operating system is actively writing, then data consistency is improved, but system performance deteriorates and storage needs increase
Solution Approach 1:
The system performs preliminary actions by identifying and copying modified blocks before the operating system writes to them, using a lookahead buffer to predict which blocks will be modified. This allows the backup process to stay ahead of write operations and reduce the need for extensive copy-on-write mode activation, thereby maintaining data consistency while improving system performance
Solution Approach 2:
The system dynamically adjusts the use of copy-on-write mode based on real-time conditions. Instead of entering copy-on-write mode continuously or preemptively, the system monitors block modification patterns and activates copy-on-write only when necessary, making the system adaptive to actual workload conditions and reducing unnecessary performance overhead
2Reliability
If copy-on-write mode is entered to ensure data consistency, then reliability is improved, but storage requirements increase due to CoW file allocation
Solution Approach 1:
The system applies partial action by using copy-on-write mode only for the specific blocks that require it, rather than allocating storage for a full copy-on-write file. The lookahead buffer identifies exactly which blocks will be modified, allowing the system to perform selective copying and avoid allocating excessive storage resources for blocks that don't need copy-on-write protection
Solution Approach 2:
The system extracts only the necessary blocks that require copy-on-write protection based on modification predictions, rather than copying or protecting all blocks. By using the lookahead buffer to identify specifically which blocks will be modified, the system removes unnecessary storage overhead and focuses resources only on the critical blocks that need consistency protection
3Quantity of substance
If the system waits for the operating system to finish writing before copying, then storage requirements are reduced, but copying time increases
Solution Approach 1:
The system performs preliminary copying actions by using the lookahead buffer to identify and copy blocks before the operating system completes its write operations. This allows the backup process to anticipate which blocks will be modified and prepare copies in advance, reducing the overall copying time without requiring excessive storage allocation
Solution Approach 2:
The system maintains continuous useful action by overlapping the backup copying process with the operating system's write operations. Instead of waiting for writes to complete before copying, the system continuously monitors and copies blocks as they are identified as modified, keeping both the operating system and backup process running concurrently and efficiently
Data Source
AI summary
The Source Volume Backup with Predictive and Lookahead Optimizations Apparatuses, Methods and Systems (“SVBAF”) transforms backup request inputs via SVBAF components into backup response outputs. A set of blocks to be copied from a source volume to a target volume is designated based on predictive optimization settings and copied based on lookahead optimization settings while an operating system is configured to write to the source volume. Blocks of the source volume that were written to by the operating system are identified. A determination is made whether to enter a CoW mode. If the CoW mode should not be entered, the designated set of blocks is changed to include at least one of the identified blocks and a pass is repeated. Otherwise, the operating system is instructed to enter the CoW mode and bring the target volume into a state consistent with a state of the source volume.