Journal-Based Replication for Continuous Data Protection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data protection systems face challenges in maintaining continuous data protection by keeping pace with high data transaction rates at production sites, leading to potential system shutdowns due to backlog of un-logged transactions at backup sites.
Innovation Solution
A system and method that integrates journal-based replication with a virtual service layer, enabling mirroring of virtual storage volumes across sites and allowing for continuous data protection by using splitters to manage and replicate I/O operations, ensuring data consistency and adaptability to changing transaction rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If journaling is used to enable continuous data protection, then data recovery capability is improved, but system productivity deteriorates due to overhead of multiple data transactions at backup site
Solution Approach 1:
The patent segments the data protection function by introducing a dedicated journaling subsystem that operates independently from the main data replication path. The journal captures change information separately from actual data blocks, allowing the backup site to track modifications without requiring full data transaction overhead, thus maintaining productivity while enabling recovery capability.
Solution Approach 2:
The patent introduces a journal as an intermediary mechanism between the production site and backup site. Instead of requiring direct synchronous data transactions for every change, the journal serves as a mediator that records change metadata and enables asynchronous replication, reducing the overhead on the backup site while maintaining data recovery capability.
2Stability of the object's composition
If backup site processes all data transactions synchronously, then data consistency is improved, but adaptability to changing transaction rates deteriorates
Solution Approach 1:
The patent implements dynamic replication by allowing the backup site to adjust its processing mode based on current transaction rates and journal backlog. When transaction rates are high, the system can switch to asynchronous replication using journal information; when rates are lower, synchronous replication can be used to maintain data consistency, thus adapting to changing conditions while preserving consistency where needed.
Solution Approach 2:
The patent changes the replication parameter from fixed synchronous replication to variable replication modes (synchronous vs. asynchronous) based on system conditions. By monitoring journal backlog and transaction rates, the system dynamically adjusts the replication parameter, enabling adaptability to varying transaction rates while maintaining data consistency when conditions permit.
3Productivity
If production site operates at high transaction rates, then productivity is improved, but reliability deteriorates due to backlog of un-logged transactions at backup site
Solution Approach 1:
The patent implements preliminary action by having the journal continuously capture and buffer change information before full replication occurs. This preliminary journaling of metadata and change information ensures that even if the backup site falls behind in processing, the change information is already recorded and can be applied later, maintaining reliability during high productivity periods.
Solution Approach 2:
The patent ensures continuity of useful action by maintaining the journal as a continuous record of changes regardless of replication status. The journaling process operates continuously at the production site, capturing all changes, while the backup site processes replications continuously as resources allow, ensuring that data protection reliability is maintained even during high transaction rate periods when full synchronization cannot be achieved immediately.
Data Source
AI summary
A system, method, and computer product for enabling a virtual service layer to consume a first storage medium and a second storage medium and map the storage mediums as one or more virtual storage volumes; wherein the one or more virtual volumes are mirrored at a first site and a second site, mirroring of the virtual storage volumes on a distributed mirror, and enabling a distributed replication service to create a continuous data protection image of the data written to one or more virtual storage volumes.