Virtual Analysis Filter for Data Replication Configuration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data protection systems face challenges in maintaining continuous data protection by keeping pace with high data transaction rates at production sites without causing downtime, as they often result in a backlog of un-logged transactions due to the overhead of journaling processes.
Innovation Solution
A computer-implemented method and system that uses a virtual analysis filter to determine the required number of virtual splitters and appliances for replicating data, optimizing WAN capacity and configuration to manage IOs efficiently, allowing for dynamic adaptation to changing data transaction rates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If journaling is used to enable continuous data protection and rollback to any point in time, then data protection capability is improved, but the overhead causes backup site to fall behind production site transaction rates
Solution Approach 1:
The patent segments the journaling overhead by introducing virtual splitters that distribute I/O transactions across multiple virtual data protection appliances. This segmentation allows the backup site to parallelize journaling operations, preventing the single-point bottleneck that causes the backup site to fall behind production transaction rates while maintaining complete data protection capability.
Solution Approach 2:
The virtual data protection appliances serve multiple functions simultaneously: they handle journaling operations, support rollback capabilities, and process I/O transactions in parallel. This multi-functionality allows the system to maintain comprehensive data protection while distributing the workload across multiple appliances, preventing any single appliance from becoming a bottleneck.
2Productivity
If the production site is forced to slow down to match backup site capacity, then backup site can keep pace with transactions, but production site availability and performance deteriorate
Solution Approach 1:
The virtual splitters act as intermediaries between the production site and backup site. They intercept I/O transactions and distribute them to multiple virtual data protection appliances without requiring the production site to slow down. This intermediary layer absorbs the overhead of journaling and distribution, allowing the production site to maintain high availability while the backup site processes transactions in parallel.
3Productivity
If multiple virtual splitters and data protection appliances are deployed to handle high transaction rates, then backup site can keep pace with production, but system complexity increases
Solution Approach 1:
The system employs dynamic configuration where virtual splitters and virtual data protection appliances can be added or removed based on transaction rates and performance requirements. This dynamic architecture allows the system to scale appropriately without requiring complete redesign, managing complexity by enabling flexible adaptation to changing workloads rather than requiring over-provisioning for peak scenarios.
4Productivity
If WAN capacity is increased to handle more replicated data, then more transactions can be backed up in real-time, but network infrastructure cost and complexity increase
Solution Approach 1:
By segmenting I/O transactions across multiple virtual data protection appliances, the patent enables parallel data replication streams over the WAN. This segmentation allows efficient utilization of available network bandwidth through multiple concurrent connections, achieving high replication throughput without requiring a single high-capacity network link, thus managing network infrastructure requirements more effectively.
Data Source
AI summary
A computer implemented method, system, and computer program product for determining how to replicate one or more volumes, the method comprising sending IOs from an IO stack through a virtual analysis filter and based on the IO sent through the virtual analysis filter, determining a number of virtual splitters and virtual data protection appliances, required WAN capacity and configuration of a replication system.