Virtual Service Layer for Active-Active Data Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data protection systems face challenges in maintaining continuous data protection by keeping pace with high data transaction rates at production sites, leading to potential system shutdowns due to backlog of un-logged transactions and limitations in recovery points in time.
Innovation Solution
The implementation of a virtual service layer (VSL) for active-active replication, allowing seamless shifting between replication techniques, including journal-based and splitter-based methods, to synchronize and mirror data across sites without initial synchronization, enabling efficient data replication and recovery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If journaling is used to enable continuous data protection and rollback to any point in time, then data recovery flexibility is improved, but system overhead increases and may force production site shutdown at high transaction rates
Solution Approach 1:
The system segments the replication function by introducing a dedicated replication appliance that separates journaling and data protection operations from the production storage system. This segmentation allows the production site to operate at full capacity while the replication appliance handles the overhead of continuous data protection, resolving the contradiction between recovery flexibility and transaction throughput.
Solution Approach 2:
A replication appliance acts as an intermediary between the production storage system and backup storage. This intermediary captures data transactions, maintains journals, and enables rollback capabilities without requiring the production system to directly handle the overhead, thus maintaining both high productivity and reliable data protection.
2Reliability
If synchronous replication is used to maintain real-time data copies, then data consistency is improved, but performance degradation occurs due to forced slowing of production site transactions
Solution Approach 1:
The replication system dynamically adapts to production site performance characteristics. The replication appliance processes transactions asynchronously when production speed is high, and can switch to synchronous modes when consistency is critical, allowing the system to maintain data consistency without permanently forcing production transactions to slow down.
Solution Approach 2:
The system performs preliminary actions by having the replication appliance pre-process and queue transactions before they reach the production system. This allows transactions to be replicated in advance without blocking the production workflow, maintaining both speed and consistency.
3Productivity
If a virtual service layer is implemented for active-active replication, then availability and concurrent access are improved, but system complexity increases
Solution Approach 1:
The virtual service layer implements a universal interface that allows multiple sites to access and replicate data concurrently through a standardized mechanism. This multi-functional approach enables active-active replication, backup, and recovery operations through a single unified system, improving availability while managing complexity through standardization.
Solution Approach 2:
The system creates virtual copies of storage volumes that can be accessed simultaneously at multiple sites. These virtual copies maintain consistency through the replication appliance's journaling mechanism, enabling concurrent read/write access without requiring complex distributed consensus protocols, thus improving productivity while controlling complexity.
4Measurement precision
If backup storage is updated continuously to match production site changes, then recovery point accuracy is improved, but the backup site may not keep pace with high transaction rates
Solution Approach 1:
The replication appliance autonomously manages the balance between replication accuracy and speed by monitoring transaction rates and adjusting its operation. When the backup site can keep pace, it maintains high recovery point accuracy; when overwhelmed, it automatically adjusts to prevent backlog, ensuring the system self-regulates to maintain both precision and speed under varying conditions.
Data Source
AI summary
A method, system, and program product for transparently shifting between using a virtual service layer (VSL) performing active-active replication which presents the volume of the first site and the volume of the second site as a single volume and a second replication technique for replicating the volume of the first site and the volume of the second site without use of the VSL.