Cross-Compression Data Replication With Lower Transfer Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data replication systems struggle to maintain high versatility and reduce communication overhead when dealing with differences in compression schemes and performance between storage systems.
Innovation Solution
A data replication system where the first storage system compresses data using a primary compression scheme and determines a compatible compression scheme with the second storage system for data transfer, allowing for efficient data replication without the need for decompression and recompression at the secondary site.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is compressed using different compression schemes between first and second storage systems, then replication versatility is improved, but communication overhead increases due to decompression and recompression requirements
Solution Approach 1:
The patent dynamically changes the compression scheme parameter based on the capabilities of the second storage system. When the second system supports the first system's compression scheme, it is used directly; otherwise, the system switches to a compatible compression scheme, thereby adapting to different system configurations while minimizing communication overhead
Solution Approach 2:
The first storage system acts as an intermediary by determining the appropriate compression scheme based on the capabilities of the second storage system. It selects and applies a compression scheme that both systems can handle, eliminating the need for decompression and recompression at the second system
2Ease of manufacture
If the second storage system is configured with reduced processing performance, then cost is reduced, but replication capability is limited when compression schemes differ
Solution Approach 1:
The first storage system is designed with multi-functionality to support multiple compression schemes. It can detect which compression schemes the second system supports and switch between different compression schemes accordingly, enabling the second system to have reduced processing performance while maintaining broad replication capability through the first system's adaptability
3Loss of energy
If compression schemes are made identical between first and second storage systems, then communication overhead is reduced, but replication versatility is limited
Solution Approach 1:
The compression scheme selection is made dynamic rather than static. The first storage system determines the compression scheme to be used based on real-time detection of the second system's capabilities. This dynamic adaptation allows the system to maintain identical compression schemes when possible (reducing overhead) while supporting multiple compression schemes when needed (maintaining versatility)
Data Source
AI summary
A first storage system compresses data relating to read and write by a primary site and stores the data in a first physical volume. A second storage system compresses data relating to read and write by a secondary site and stores the data in a second physical volume. When performing replication for transferring the data stored in the first physical volume of the first storage system to the second storage system and storing the data in the second physical volume, the first storage system and the second storage system determine, based on a compression scheme executable by the first storage system and a compression scheme executable by the second storage system, a compression scheme to be applied to transfer target data and transfer the transfer target data compressed by the determined compression scheme.