Backup Checkpoint Interval Control via Dynamic Transfer Frame Sizing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data backup systems face challenges in efficiently managing checkpoint intervals during backup operations, as administrators struggle to set optimal transfer frame sizes to achieve desired time intervals between checkpoints, especially due to varying data transfer rates and system loads.
Innovation Solution
The system allows administrators to specify checkpoint intervals based on time rather than data size, with the backup software dynamically adjusting the transfer frame size based on actual transfer rates to match the desired time interval, using protocols like NDMP to control data transfer and create checkpoints for efficient restarts in case of failures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a fixed transfer frame size is used for backup operations, then the backup process is simple to implement, but the checkpoint time intervals cannot be controlled consistently under varying data transfer rates
Solution Approach 1:
The transfer frame size is made dynamic rather than fixed. The backup software automatically adjusts the transfer frame size based on actual data transfer rates to maintain consistent checkpoint time intervals. This allows the system to adapt to varying network conditions and storage speeds without requiring manual intervention.
Solution Approach 2:
The system implements feedback by monitoring actual data transfer rates and using this information to adjust transfer frame sizes. The backup software measures transfer performance and modifies subsequent transfer frame sizes to achieve the desired checkpoint timing, creating a closed-loop control system.
2Productivity
If the transfer frame size is increased to reduce checkpoint frequency, then backup overhead is reduced, but the time interval between checkpoints becomes unpredictable
Solution Approach 1:
The transfer frame size dynamically adapts to maintain predictable checkpoint time intervals while optimizing backup efficiency. Rather than using a static large frame size that creates unpredictable timing, the system adjusts frame sizes in real-time to ensure consistent checkpoint intervals.
Solution Approach 2:
The system changes the parameter of transfer frame size based on actual transfer rates and desired checkpoint intervals. By calculating the appropriate frame size from the relationship between transfer rate and time interval, the system achieves both efficiency and timing consistency.
3Reliability
If the transfer frame size is decreased to increase checkpoint frequency, then time interval consistency is improved, but backup overhead and downtime increase
Solution Approach 1:
The transfer frame size is dynamically adjusted to achieve the optimal balance between checkpoint frequency and time interval consistency. The system prevents both excessive checkpoint frequency (which causes downtime) and insufficient frequency (which reduces consistency), by calculating the precise frame size needed.
Solution Approach 2:
The backup software self-adjusts the transfer frame size based on actual transfer rates without requiring external intervention. The system automatically calculates and modifies frame sizes to maintain reliable checkpoint intervals while minimizing overhead.
4Ease of operation
If administrators manually set transfer frame sizes to achieve desired checkpoint intervals, then time-based control is possible, but system complexity and configuration difficulty increase
Solution Approach 1:
The backup software performs self-adjustment of transfer frame sizes based on monitored transfer rates. Administrators simply specify the desired checkpoint time interval, and the system automatically calculates and modifies frame sizes without requiring manual configuration or adjustment.
Solution Approach 2:
The system automatically changes the transfer frame size parameter based on actual transfer rates and the desired checkpoint interval. This eliminates the need for administrators to manually calculate and adjust frame sizes, simplifying operation while maintaining time-based control.
Data Source
AI summary
A system and method for controlling a backup operation to backup data from a source device to a backup storage device are described. Backup software creates checkpoints during the backup operation. Each checkpoint represents a point from which the backup operation can be re-started in case of failure. The backup software enables an administrator to specify a desired time interval between the checkpoints. The backup operation is performed using a backup protocol which uses a transfer frame size to determine when to create each checkpoint. The backup software translates the checkpoint time interval specified by the administrator into an appropriate transfer frame size in order to achieve the desired checkpoint time interval. The transfer frame size may be dynamically adjusted between each checkpoint.