Selective Data Mirroring Across Heterogeneous Storage Formats
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data mirroring techniques in computer systems face challenges in efficiently managing data stored in different formats and structures across multiple storage entities, leading to complexities in synchronization and data accessibility across heterogeneous storage systems.
Innovation Solution
A method and system for mirroring data that intercepts write operations on a host, determines if a primary storage entity is mirrored as a secondary storage entity with a different format and structure, and performs processing to mirror the data accordingly, including partitioning, transforming, and embedding metadata to ensure seamless data replication across storage entities within the same data storage system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data mirroring is performed between storage entities with different formats and structures, then data accessibility and redundancy are improved, but system complexity and synchronization difficulty increase
Solution Approach 1:
The host system acts as an intermediary between storage entities with different formats and structures. The host intercepts write operations, determines whether mirroring is needed, and performs format conversion before issuing write operations to the mirror storage entity. This mediator approach enables data redundancy across heterogeneous storage systems without requiring the storage entities themselves to handle format conversion, thus improving reliability while managing complexity at the host level.
Solution Approach 2:
The system changes data format parameters during the mirroring process. When a write operation is intercepted and mirroring is determined to be necessary, the host transforms the data from the first format and structure to the second format and structure before writing to the mirror storage entity. This parameter transformation enables compatibility between different storage systems while maintaining data redundancy.
2Adaptability or versatility
If format transformation is performed during data mirroring, then data compatibility across heterogeneous systems is improved, but processing time and operational complexity increase
Solution Approach 1:
The host system performs format transformation as a preliminary action before issuing write operations to the mirror storage entity. By intercepting the write operation first, determining mirroring requirements, and completing the format transformation beforehand, the system ensures data compatibility is established in advance, making the actual mirroring operation straightforward and manageable.
3Reliability
If synchronous mirroring is implemented, then data integrity is improved, but mirroring speed and performance may be reduced
Solution Approach 1:
The system dynamically handles mirroring operations by intercepting write operations and determining the appropriate mirroring approach based on the specific situation. The host can perform format transformation and issue mirror write operations in a manner that balances data integrity requirements with performance considerations, allowing flexible adaptation between synchronous and asynchronous mirroring behaviors depending on the operational context.
Data Source
AI summary
Described are techniques for mirroring data that may include issuing, by an application on a host, a write operation that writes first data to a primary storage entity having data stored in accordance with a first format and first structure; intercepting, on the host, the write operation; and performing, on the host, first processing to process the write operation. The first processing may include: sending the write operation to a data storage system including the primary storage entity; determining whether the primary storage entity is mirrored as a second storage entity having data stored in a second format and second structure different from the first format and first structure; and responsive to determining the primary storage entity is mirrored as the second storage entity, issuing one or more second write operations to mirror the first data on the second storage entity in accordance with the second format and second structure.