Host-Orchestrated Data Copy With Independent Error Verification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data corruption during the copy operation between data storage systems is not promptly detected, leading to potential costly issues and difficulty in identifying bugs in the optimized copy logic.
Innovation Solution
A host performs an optimized copy operation, followed by a target data storage system generating a complete unoptimized copy and using independent error detection to identify mismatched chunks. The host then performs an unoptimized copy operation to correct the data, independent of the potentially faulty optimized copy logic.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If an optimized copy operation is used to improve copy speed, then productivity is improved, but reliability deteriorates due to undetected data corruption
Solution Approach 1:
An independent error detection communication channel is introduced as an intermediary between the source and target storage systems. This separate channel transmits verification information and performs error detection independently from the optimized copy operation, allowing the copy to proceed at high speed while corruption is detected through the mediator channel without affecting the copy performance
Solution Approach 2:
A complete unoptimized copy is created in parallel as a verification copy. This copy serves as a reference to compare against the optimized copy, enabling detection of data corruption. The unoptimized copy acts as a backup verification mechanism that can identify errors in the optimized copy without interfering with the primary copy operation
2Reliability
If error detection is performed independently from the host, then reliability is improved, but device complexity increases
Solution Approach 1:
The error detection functionality is merged into the target storage system itself rather than being a separate external system. The target storage system performs both the copy reception and the error detection operations, combining multiple functions into a single system to reduce overall system complexity while maintaining independent error detection capability
Solution Approach 2:
The target storage system performs self-verification by comparing received data against verification information and the unoptimized copy. The system serves its own error detection needs without requiring external verification systems, reducing complexity while maintaining reliable error detection
Data Source
AI summary
A host performs an optimized copy operation by reading an optimized version of data from a source data storage system, and then writing the optimized version of the data to a target data storage system. The target uses the optimized version of the data to generate a complete unoptimized copy of the data, and obtains data verification information from the source through an independent error detection communication channel that is independent from the host. The target uses the data verification information and the complete unoptimized copy of the data to perform an error detection operation that identifies any chunk within the complete unoptimized copy of the data in the target that does not match the data in the source. The target indicates the non-matching chunks to the host, and the host performs an unoptimized copy of those chunks from the source to the target to correct the error.