Adaptive Replication Modes for Storage System Latency

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing replication methods, such as synchronous and asynchronous replication, face challenges in managing IO latency and system overload, leading to potential data loss and increased lag times during disaster recovery, with users experiencing higher IO latency or timeouts in synchronous replication and increased lag times in asynchronous replication.

Innovation Solution

The implementation of adaptive replication modes that monitor write IO operations, collect data on latency, and automatically switch between synchronous and asynchronous replication based on predefined threshold values to compensate for operational deficiencies, ensuring seamless transitions and optimal performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If synchronous replication is used to prevent data loss, then data reliability is improved, but write IO latency increases

Engineering Contradiction:

Improvedata reliabilityVSAvoidwrite IO latency

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system dynamically switches between synchronous and asynchronous replication modes based on real-time monitoring of write IO latency and threshold conditions, making the replication mechanism adaptive rather than static to balance reliability and performance

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes the operational parameters of replication by switching between sync and async modes, altering the behavior of the replication process based on collected performance data and threshold comparisons

Inventive Principle:

Principle #35Parameter changes

2Productivity

If asynchronous replication is used to reduce IO latency, then write performance is improved, but data loss risk increases

Engineering Contradiction:

Improvewrite performanceVSAvoiddata loss risk

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system dynamically adjusts replication mode based on monitored conditions, switching to synchronous replication when thresholds indicate risk and to asynchronous replication when conditions permit, creating a responsive balance between performance and safety

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system collects data from write IO operations, determines latency metrics, compares against thresholds, and uses this feedback loop to automatically switch replication modes, ensuring data protection when needed while maintaining performance

Inventive Principle:

Principle #23Feedback

3Reliability

If synchronous replication is used during system overload, then data integrity is maintained, but system throughput decreases

Engineering Contradiction:

Improvedata integrityVSAvoidsystem throughput

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The replication system dynamically adapts its behavior based on system conditions, switching modes to maintain data integrity when necessary while allowing throughput to improve when system overload conditions are alleviated

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes replication operational parameters based on monitored system conditions and threshold comparisons, adjusting the replication mode to balance data integrity requirements with system throughput capabilities

Inventive Principle:

Principle #35Parameter changes

4Ease of operation

If manual monitoring and switching between replication modes is performed, then operational control is improved, but system complexity increases

Engineering Contradiction:

Improveoperational controlVSAvoidsystem complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system performs self-monitoring and self-switching between replication modes automatically based on collected data and threshold comparisons, eliminating the need for manual intervention while maintaining operational control

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system implements an automated feedback mechanism that collects performance data, compares it against thresholds, and triggers automatic mode switching, replacing complex manual monitoring procedures with an autonomous control system

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11487463B2Adaptive replication modes in a storage system

Publication Date: 2022.11.01 EMC IP HLDG CO LLC

AI summary

In one aspect, adaptive replication modes in a storage system are provided. An aspect includes during an active replication session in which a first type of replication is performed at the storage system, monitoring write input/output (IO) operations, collecting data from the write IO operations, and determining, from the collected data, write IO latency. Upon determining that a threshold value has been met from the write IO latency, where the threshold value is defined for the first type of replication, an aspect includes automatically switching from the first type of replication to a second type of replication. The second type of replication is configured to compensate for operational deficiencies detected in response to the write IO latency.