Write by Peer Reference Offload for Storage Mirroring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data mirroring systems face inefficiencies in replicated writes, re-synchronization, and rebalancing operations due to high network traffic and latency, as they require data block transmission between storage device clients and multiple mirror peers.
Innovation Solution
The implementation of a 'write by-peer-reference' method, where a storage device client sends a write request to a target storage device specifying a source storage device, allowing the target device to read and write the data block directly from the source, reducing network traffic and latency by eliminating the need for data block transmission through the client.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data blocks are transmitted from storage device clients to multiple mirror peers for replicated writes, then data redundancy is ensured, but network traffic and latency increase significantly
Solution Approach 1:
The patent extracts the data block transmission step from the replicated write process. Instead of clients sending data to all mirror peers, the client sends data to only one peer, and that peer retrieves data from source peers directly, eliminating redundant network transmissions while maintaining redundancy
Solution Approach 2:
The target mirror peer acts as an intermediary that receives the write request from the client and then independently retrieves data from source mirror peers. This intermediary approach allows the system to maintain redundancy requirements while reducing client network traffic
2Reliability
If data blocks are transmitted through clients during re-synchronization operations, then mirror peers can be synchronized, but network traffic and operation time increase
Solution Approach 1:
The patent removes the client from the data transmission path during re-synchronization. The target mirror peer directly retrieves data blocks from source mirror peers without involving the client, thereby accelerating the re-synchronization process while ensuring data consistency
Solution Approach 2:
Mirror peers perform re-synchronization autonomously by directly communicating with each other. The target peer initiates and completes the synchronization process independently without requiring client intervention, improving operational efficiency
3Ease of operation
If clients manage all data block transmissions for mirroring operations, then control and coordination are simplified, but network traffic and latency increase
Solution Approach 1:
The patent segments the data transmission task between clients and mirror peers. Clients handle only the initial write request, while mirror peers handle the actual data block retrieval and distribution, dividing responsibilities to optimize performance
Solution Approach 2:
Mirror peers serve as intermediaries that take over the data transmission burden from clients. This intermediary role allows clients to maintain control over the mirroring logic while delegating the time-consuming data transfer operations to storage devices
Data Source
AI summary
In a write by-peer-reference, a storage device client writes a data block to a target storage device in the storage system by sending a write request to the target storage device, the write request specifying information used to obtain the data block from a source storage device in the storage system. The target storage device sends a read request to the source storage device for the data block. The source storage device sends the data block to the target storage device, which then writes the data block to the target storage device. The data block is thus written to the target storage device without the storage device client transmitting the data block itself to the target storage device.