Data Replication Transition with Loss Prevention

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data storage systems face challenges in preventing data loss during transitions from a replication source, particularly in ensuring data integrity and availability across multiple storage nodes.

Innovation Solution

The proposed solution involves a method for configurable data replication that includes mechanisms for data loss prevention during transitions. This is achieved by utilizing storage array controllers that manage data across multiple storage nodes, employing techniques such as direct-mapped flash storage systems, dual Peripheral Component Interconnect (PCI) flash storage devices, and erasure coding schemes to ensure data redundancy and integrity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If data replication is implemented across multiple storage nodes, then data availability and reliability are improved, but system complexity increases

Engineering Contradiction:

Improvedata availabilityVSAvoidsystem complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system divides data into multiple segments or shards that are distributed across different storage nodes. Each node stores a portion of the data, and the system uses segmentation to manage replication independently at each node, reducing overall system complexity while maintaining data availability across multiple locations

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary layer or controller that manages the complexity of data replication between storage nodes. This intermediary handles the coordination, tracking, and management of replicated data, isolating the complexity from both the client applications and the individual storage nodes

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If data redundancy mechanisms are implemented, then data loss prevention is improved, but storage space requirements increase

Engineering Contradiction:

Improvedata loss preventionVSAvoidstorage space

Core Design Contradiction:

ReliabilityVSQuantity of substance

Solution Approach 1:

The system creates copies of data segments and distributes them across multiple storage nodes. Instead of storing complete redundant copies of entire datasets, the copying principle is applied selectively to data segments, providing data loss prevention while optimizing storage space utilization through partial replication

Inventive Principle:

Principle #26Copying

Solution Approach 2:

Different storage nodes have different qualities or capacities for data storage. The system applies local quality by storing redundant copies strategically on nodes with appropriate characteristics, optimizing the balance between data loss prevention and storage space consumption based on local node capabilities

Inventive Principle:

Principle #3Local quality

3Reliability

If seamless transition mechanisms are implemented during node failures, then service continuity is improved, but processing overhead increases

Engineering Contradiction:

Improveservice continuityVSAvoidprocessing overhead

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-configuring backup data segments and establishing failover relationships between storage nodes before failures occur. When a node fails, the transition to backup nodes can proceed seamlessly because the replication relationships and data segments were already established in advance, reducing processing overhead during actual failure events

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms that monitor the health and status of storage nodes continuously. This feedback enables the system to detect node failures early and initiate transition procedures automatically, maintaining service continuity while optimizing processing overhead by only activating redundant pathways when actually needed based on real-time feedback

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS12210762B2Transitioning between source data repositories for a dataset

Publication Date: 2025.01.28 PURE STORAGE INC

AI summary

Transitioning between replication sources for data replication operations, including: delaying a transition from using a first data repository as a source for data replication to using a second data repository as the source for data replication after detecting that one or more storage operations directed to the first data repository have not been replicated to the second data repository; and promoting the second data repository as the source for data replication such that storage operations received after completing the transition are directed to the second data repository.