Hybrid Replication for Storage I/O Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data replication systems face inefficiencies in handling unaligned write requests, leading to increased workload and latency, and often require high network bandwidth and storage resources, especially when validating point-in-time data replicas and managing journal lag.
Innovation Solution
A hybrid replication technique that aligns write requests by determining their alignment to storage segment boundaries, using continuous replication for aligned requests and snapshot replication for unaligned requests, with a dirty data tracking mechanism to optimize data transfer and reduce network bandwidth.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If snapshot replication is used for all write requests, then data protection is provided, but network bandwidth consumption and storage resources increase
Solution Approach 1:
The patent applies different replication strategies to different portions of data based on their alignment characteristics. Aligned write requests are handled with continuous replication to minimize network bandwidth consumption, while unaligned write requests are handled with snapshot replication to ensure data protection. This local differentiation resolves the contradiction by optimizing resource usage for each specific case rather than applying a uniform approach to all data.
Solution Approach 2:
The patent changes the replication parameter (continuous vs. snapshot) based on the alignment parameter of write requests. By monitoring the alignment status of write requests and dynamically switching between replication modes, the system achieves both efficient network bandwidth usage and comprehensive data protection, resolving the contradiction between resource efficiency and reliability.
2Loss of time
If continuous replication is used for all write requests, then low RPO is achieved, but workload on storage media and network bandwidth increase
Solution Approach 1:
The patent differentiates between aligned and unaligned write requests, applying continuous replication only to aligned requests where it can maintain low RPO without excessive workload. Unaligned requests are handled through snapshot replication, which reduces the workload on storage media while still providing data protection. This selective application resolves the contradiction by matching the replication method to the specific characteristics of each write request.
Solution Approach 2:
The patent segments write requests into two categories: aligned and unaligned. By segmenting the replication approach based on alignment characteristics, the system can apply continuous replication (low RPO) only where necessary and use snapshot replication (lower workload) for other cases, thus resolving the contradiction between RPO performance and storage media workload.
3Productivity
If alignment checking is performed on all write requests, then replication efficiency is improved, but processing overhead increases
Solution Approach 1:
The patent extracts only the alignment information from write requests to determine the appropriate replication strategy, rather than performing full validation or processing of each request. This selective extraction of critical alignment data improves replication efficiency while minimizing processing overhead, as the alignment check is a simple operation compared to full request validation.
Data Source
AI summary
Described embodiments provide systems and methods for operating a storage system. A plurality of storage segments of a production volume of the storage system are identified. Write requests to be written to the production volume are received during an operating time window. An alignment of the received write requests to one or more of the plurality of segments of the production volume is determined. For write requests that are not aligned to the one or more of the plurality of segments of the production volume, snapshot replication is performed. For write requests that are aligned to the one or more of the plurality of segments of the production volume, continuous replication is performed.