Watermark-Based IO Routing for Seamless Storage Migration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional storage migration techniques are inefficient, consuming significant computational and network resources and degrading overall system performance due to inadequate handling of input-output operations during seamless migration of logical storage devices between storage arrays.
Innovation Solution
The implementation of a watermark system by the target storage array, which provides progress information to the host device, enabling it to direct IO operations to the appropriate storage array for optimal performance by determining whether to send read or write operations to the source or target array based on the watermark information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional migration approaches are used, then migration functionality is achieved, but computational and network resources are significantly consumed and overall system performance is degraded
Solution Approach 1:
The patent introduces a watermark mechanism as an intermediary between the source and target storage arrays. The watermark indicates the progress of data migration and allows the host device to intelligently route IO operations without requiring the host to manage the complex migration process directly. This intermediary abstraction layer reduces the computational burden on the host and optimizes resource utilization during migration.
Solution Approach 2:
The migration process is segmented into distinct phases based on watermark positions. The host device divides IO operations into those that should be sent to the source array and those that should be sent to the target array, based on the watermark indicating which data blocks have been migrated. This segmentation allows efficient resource utilization by directing operations to the appropriate storage system.
2Productivity
If conventional migration approaches are used, then data can be migrated between storage arrays, but overall system performance is degraded due to inadequate handling of IO operations
Solution Approach 1:
The patent implements a dynamic IO routing mechanism where the host device continuously adjusts the destination of IO operations based on the current watermark position. As migration progresses and the watermark advances, the host dynamically redirects IO operations from the source array to the target array. This dynamic adaptation ensures that IO operations are always directed to the most appropriate storage system, maximizing performance and minimizing processing time.
Solution Approach 2:
The watermark mechanism provides continuous feedback to the host device about the migration progress. The host uses this feedback to make real-time decisions about IO operation routing. This feedback loop ensures that the system adapts to the current migration state and optimizes performance accordingly, preventing unnecessary IO operations to the source array once data has been migrated to the target.
3Reliability
If seamless migration is implemented, then continuous access to logical storage devices is maintained, but determining the appropriate destination for IO operations becomes complex
Solution Approach 1:
The watermark serves as a simple intermediary indicator that abstracts the complexity of migration management from the host device. Instead of requiring the host to track individual data block migration status or manage complex routing logic, the watermark provides a single, easy-to-interpret indicator of migration progress. This simplifies the host's decision-making process while maintaining seamless access to logical storage devices.
Solution Approach 2:
The patent changes the parameter used for IO routing from a complex multi-factor decision process to a simple threshold-based decision based on the watermark position. The host compares the logical address of each IO operation against the watermark value and routes accordingly. This parameter change from complex multi-dimensional routing logic to a simple single-parameter threshold comparison dramatically reduces complexity while maintaining reliability.
Data Source
AI summary
An apparatus comprises a host device configured to communicate over a network with source and target storage systems. The host device, in conjunction with migration of a logical storage device from the source storage system to the target storage system, is further configured to obtain from the target storage system watermark information characterizing progress of the migration of the logical storage device from the source storage system to the target storage system, and to determine whether a given input-output operation is to be sent to the source storage system or the target storage system based at least in part on the watermark information obtained from the target storage system. The watermark information illustratively identifies a particular logical address in the logical storage device, up to and including for which corresponding data has already been copied from the source storage system to the target storage system in conjunction with the migration.