Dynamic Checkpoint Update for Data Copying
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face inefficiencies in updating checkpoint data during data copying processes, leading to resource contention and performance issues due to frequent or infrequent checkpointing, which can result in suboptimal data synchronization progress tracking.
Innovation Solution
A method that calculates a threshold ratio (Rcalc) based on non-recorded synchronization progress, average time delay between I/O operations, average I/O operation time, and concurrent synchronization count to dynamically determine when to update checkpoint data, thereby optimizing checkpoint frequency and reducing resource contention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If checkpoint data is updated frequently during data copying, then data synchronization progress tracking is more accurate, but resource contention increases and system performance deteriorates
Solution Approach 1:
The patent implements dynamic checkpoint frequency adjustment by calculating a threshold ratio (Rcalc) that adapts to current system conditions. The system transitions from fixed-frequency checkpointing to dynamic checkpointing, where the update frequency changes based on real-time factors including non-recorded synchronization progress, average I/O operation time, and concurrent synchronization count. This resolves the contradiction by making the system flexible rather than static.
Solution Approach 2:
The patent changes the parameter of checkpoint update frequency from a constant value to a dynamically calculated threshold ratio (Rcalc). This ratio is computed based on multiple system parameters: non-recorded synchronization progress (NRSP), average time delay between I/O operations (IOI), average I/O operation time (AIOR), and concurrent synchronization count (CSC). By changing this parameter dynamically, the system achieves both accurate progress tracking and maintained performance.
2Productivity
If checkpoint data is updated infrequently, then resource contention is reduced and system performance is maintained, but data synchronization progress tracking becomes less accurate
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously monitors four key parameters (NRSP, IOI, AIOR, CSC) and uses them to calculate the threshold ratio Rcalc. This feedback loop ensures that checkpoint updates occur at optimal moments based on actual system state rather than predetermined schedules. The feedback mechanism resolves the contradiction by providing just enough updates to maintain accuracy without excessive updates that would harm performance.
Solution Approach 2:
The patent performs preliminary calculation of the threshold ratio Rcalc before executing checkpoint updates. By pre-calculating whether a checkpoint should be updated based on current system parameters, the system avoids unnecessary updates and prepares optimal update timing in advance. This preliminary action resolves the contradiction by preventing both excessive updates (which hurt performance) and insufficient updates (which reduce accuracy).
3Productivity
If multiple concurrent data synchronizations are performed, then data copying throughput increases, but resource contention increases and checkpoint management becomes more complex
Solution Approach 1:
The patent merges the checkpoint management logic into a unified threshold ratio calculation that handles multiple concurrent synchronizations simultaneously. Instead of managing checkpoints separately for each synchronization operation, the system combines all relevant parameters (including total concurrent synchronization count CSC) into a single Rcalc formula. This merging approach resolves the contradiction by simplifying management while supporting high concurrency.
Solution Approach 2:
The patent creates a universal checkpoint update mechanism that serves multiple concurrent synchronization operations through a single threshold ratio calculation system. The same Rcalc formula and checkpoint update logic apply regardless of how many synchronizations are running concurrently, making the system multi-functional and scalable. This universality resolves the contradiction by preventing management complexity from increasing linearly with concurrency.
Data Source
AI summary
Described are techniques for updating checkpoint data during a copy process that copies data from a first device to a second device. A portion of data is copied from the first device to the second device. A first calculated value is determined in accordance with a plurality of factors. In accordance with the first calculated value and a threshold ratio, it is determined whether to update the checkpoint data denoting progress of the copying process that copies data from the first device to the second device. If it is determined to update the checkpoint data, first processing is performed that updates the checkpoint data.