Snapshot Replication via Hint-Based Difference Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Enterprise storage systems face challenges in efficiently utilizing storage space due to the large consumption of resources for storing snapshots, which can be mitigated by synchronizing snapshots between different types of storage systems.
Innovation Solution
The method involves identifying a snapshot to be replicated from a source storage system to a destination storage system, determining the most recent version on the destination system, requesting and transferring the differences in data between the two snapshots, and storing the associated data, thereby optimizing storage usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If snapshots are stored within the storage system itself, then snapshot replication is enabled, but valuable storage space is consumed
Solution Approach 1:
The patent segments the snapshot data into two parts: hint information (metadata) stored in the storage system and actual snapshot data stored externally. This segmentation allows the storage system to maintain snapshot replication capability while minimizing internal storage consumption by storing only lightweight hint information locally.
Solution Approach 2:
The patent introduces an external storage location as an intermediary to hold the actual snapshot data. The storage system communicates with this external location through hint information, enabling snapshot replication without consuming valuable internal storage space for the actual snapshot data.
2Reliability
If complete snapshots are transferred between storage systems, then snapshot synchronization is achieved, but data transfer time and network bandwidth are increased
Solution Approach 1:
The patent extracts only the necessary data differences (changes) between snapshots for transfer, rather than transferring complete snapshots. By using hint information to identify what has changed, the system achieves snapshot synchronization while minimizing data transfer time and network bandwidth consumption.
Solution Approach 2:
The patent applies partial action by transferring only the portion of data that has changed between snapshots (data differences), rather than transferring the entire snapshot. This selective transfer approach maintains synchronization reliability while significantly reducing transfer time.
3Adaptability or versatility
If snapshots are replicated across different types of storage systems, then storage flexibility is improved, but compatibility challenges arise
Solution Approach 1:
The patent creates a universal hint information format that can be used across different types of storage systems regardless of their specific architectures. This universal approach enables snapshot replication between heterogeneous storage systems (e.g., FlashArray to Cloud, or between different storage vendors) without requiring system-specific implementations, thereby improving adaptability while managing complexity.
Data Source
AI summary
Synchronizing snapshots between storage systems, including: receiving, from a source storage system, an identification of a snapshot to be replicated to a destination storage system; identifying, from hint information stored on the destination storage system, a most recent version of the snapshot that is stored on the destination storage system; issuing, to the source storage system, a request for an identification of the differences between the snapshot to be replicated to the destination storage system and the most recent version of the snapshot that is stored on the destination storage system; receiving, from the source storage system, the identification of the differences; and issuing a request to transfer, from the source storage system to the destination storage system, data associated with the differences.