Crash Consistent Storage via Non-Volatile Circular Buffer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data protection systems require system shutdown during backups, limit recovery points in time, and have lengthy data recovery processes, failing to provide continuous data protection with minimal downtime and precise recovery capabilities.
Innovation Solution
A method using a tracking structure to map non-volatile storage, enabling a logical representation for writable storage, which persists data writes and allows for crash-consistent checkpoints through undo and redo logging, extending volatile memory with flash storage and managing logs to ensure data consistency and recovery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional tape backup systems are used for data protection, then data can be stored periodically, but the system requires shutdown during backup and has lengthy recovery times
Solution Approach 1:
The system performs preliminary actions by continuously writing data to a circular buffer in non-volatile storage before any potential failure occurs. The circular buffer continuously overwrites old data with new data, ensuring that recent data is always available for recovery without requiring system shutdown or manual intervention.
Solution Approach 2:
The data protection mechanism operates continuously in the background without interrupting system operations. The circular buffer continuously accepts new data writes and maintains a history of recent data states, enabling continuous protection while the system remains fully operational.
2Reliability
If conventional tape backup systems are used for data protection, then data can be stored periodically, but recovery is limited to specific time points and takes a long time
Solution Approach 1:
The system prepares recovery data in advance by continuously maintaining a circular buffer of recent data states. When recovery is needed, the system can immediately retrieve data from any recent point in time without waiting for lengthy backup operations to complete.
Solution Approach 2:
The system creates continuous copies of data in the circular buffer structure, where each new write operation creates a new version while preserving access to previous versions. This copying mechanism enables rapid recovery to any recent time point by simply reading from the appropriate buffer location.
3Loss of time
If continuous data protection is implemented, then recovery time is minimized and any point in time can be recovered, but system complexity increases
Solution Approach 1:
The data protection system is segmented into simple, discrete components: a circular buffer structure with clear read/write pointers, checksum validation, and checkpoint markers. This segmentation makes the system easier to implement and maintain compared to complex continuous backup systems.
Solution Approach 2:
The circular buffer automatically manages data storage and retrieval without requiring complex external management systems. The buffer self-manages overflow by overwriting old data, automatically tracks write positions, and maintains data integrity through simple checksum validation, reducing overall system complexity.
Data Source
AI summary
A method, system, and computer program product comprising using a tracking structure to map a first portion and a second portion of a non-volatile storage medium to a logical representation of the non-volatile storage medium; wherein the first portion is presented by the logical representation as writable storage and using the tracking structure to enable the logical representation to present the data written to the second portion as the data corresponding to the write in the first portion.