Data Probe Restore Flow for Uninterrupted Stream-Level Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Backup and restore operations often abort unexpectedly, leading to partially written or corrupted data and increased backup or restore windows, requiring restarts from the beginning despite completed portions of data.
Innovation Solution
A data probe approach using a cache disk array to capture and utilize marginal footprints of data during backup and restore operations, allowing for uninterrupted sessions by identifying abrupt aborts and resuming from the last successful write or read point.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If backup or restore operation aborts due to unexpected events, then the operation must be restarted from the beginning, but this causes increase in backup or restore window and loss of time
Solution Approach 1:
The system performs preliminary actions by capturing footprints of data packets during the backup/restore operation and storing them in a cache disk array before the operation completes. This preliminary capture of operational state information enables the system to resume from the exact interruption point without restarting from the beginning, thus reducing time loss while maintaining reliability.
Solution Approach 2:
The system implements feedback mechanisms where the cache disk array stores footprints of data packets and operational status. When an abort occurs, the system uses this feedback information to determine the exact point of interruption and resume the operation from that point, rather than restarting from the beginning. This feedback loop enables continuous operation and reduces the backup/restore window.
2Reliability
If backup or restore operation aborts unexpectedly, then data may be partially written back to the target device, but this causes data corruption and requires complete reoperation
Solution Approach 1:
The system captures footprints of data packets and stores them in the cache disk array during the backup/restore operation. This preliminary action creates a record of what data was successfully transferred and in what state, enabling the system to resume from the exact point of interruption and avoid data corruption by ensuring complete and consistent data writing without requiring complex manual intervention.
3Productivity
If successive backups or restores are needed after abort, then the operation must restart from the beginning, but this increases the backup or restore window
Solution Approach 1:
The system enables continuity of useful action by maintaining footprints of data packets in the cache disk array throughout the backup/restore operation. When an abort occurs, the system can immediately resume from the last successful point using these preserved footprints, rather than restarting from the beginning. This continuous utilization of operational state information eliminates idle time and maintains productivity while reducing the overall backup/restore window.
Data Source
AI summary
Methods and systems for restoring data from a target device are described. According to some embodiments, the method receives a first set of data packets for restore, where the first set of data packets includes a multiplicity of data chunks. The method further captures footprints of the first set of data packets in a cache disk array. In response to receiving an acknowledgement from the cache disk array indicating the footprints of the first set of data packets have been captured, the method pushes each data chunk of the first set of data packets to a construction container for reconstruction of backup data. In response to receiving an acknowledgement from the construction container indicating the data chunk is successfully pushed, the method flushes the respective footprint of the data chunk from the cache disk array.