Journal Group Consolidation for Distributed Storage Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In a disaster recovery environment where an on-premise storage system is coupled with a distributed storage system, the distribution of copy destination volumes across multiple nodes leads to an increase in the number of journal groups, deteriorating processing efficiency and performance due to increased journal processing overhead.
Innovation Solution
The solution involves forming consistency holding groups with primary and secondary volumes, ensuring data replication consistency through journal processing, and arranging secondary volumes based on node resource usage and node count, thereby limiting the distribution of copy destination volumes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If copy destination volumes are distributed across multiple nodes in the distributed storage system, then the system can provide disaster recovery capability and utilize available storage capacity, but the number of journal groups increases, causing processing efficiency to deteriorate and performance to decrease
Solution Approach 1:
The patent merges multiple journal groups into a single journal group by consolidating copy destination volumes onto a single node. This allows the system to maintain disaster recovery capability while reducing the number of journal groups from multiple (one per node) to one, thereby improving processing efficiency and performance.
Solution Approach 2:
The patent makes a single node serve multiple functions: it acts as both the primary storage node for the on-premise storage system and as the consolidated destination for multiple copy destination volumes in the distributed storage system. This multi-functionality allows disaster recovery without requiring separate journal groups for each node.
2Quantity of substance
If copy destination volumes are distributed across multiple nodes, then storage capacity can be utilized across the distributed system, but the number of journal groups increases, causing overhead of journal processing to increase and performance to deteriorate
Solution Approach 1:
The patent combines multiple journal groups that would otherwise be created on different nodes into a single journal group on one node. This reduces the device complexity (number of journal groups) while still utilizing the storage capacity of the distributed system for copy destination volumes.
3Ease of operation
If copy destination volumes are distributed across multiple nodes, then the system can balance load across nodes, but the number of journal groups increases, causing processing overhead to increase and performance to decrease
Solution Approach 1:
The patent merges journal processing operations into a single journal group, eliminating the need for multiple coordinated journal groups across nodes. This reduces journal processing overhead and time loss, while load balancing is maintained at the volume distribution level rather than the journal group level.
Data Source
AI summary
A first journal group including a primary volume and a first journal volume and a second journal group including a secondary volume and a second journal volume are set in a consistency holding group. Journal processing is performed while ensuring consistency of replication between the first journal group and the second journal group. The second journal group is arranged for each node in which the secondary volume of the consistency holding group is arranged. The secondary volume is arranged in each node in the second storage system based on a usage status of a resource of each node in the second storage system and the number of nodes in which the secondary volume in the consistency holding group is arranged.