Converged Storage Data Migration via I/O Event Notices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Converged storage systems face performance degradation during data migration due to resource competition and excessive communication overhead when transferring data between I/O nodes, limiting flexibility and efficiency in hardware configuration.
Innovation Solution
A converged system architecture that separates I/O processing from transfer processing, offloading transfer operations to a different calculation node while maintaining data consistency through I/O processing event notices, allowing for efficient data transfer without overloading I/O nodes or calculation nodes where applications operate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data transfer is performed via general connecting path in packaged converged storage system, then hardware configuration flexibility is improved, but data transfer speed and system performance are degraded
Solution Approach 1:
The patent segments the storage system into multiple independent chassis that can be connected via general connecting paths. Each chassis maintains its own I/O nodes and calculation nodes, allowing flexible hardware configuration while enabling data transfer between chassis through the segmented architecture. This resolves the contradiction by allowing both general connecting paths and dedicated transfer capabilities at different levels.
2Loss of time
If continuous data transfer processing is executed for long period, then data migration is completed, but I/O processing and communication processing are delayed causing performance degradation
Solution Approach 1:
The patent implements preliminary action by pre-establishing dedicated connecting paths between I/O nodes before data transfer begins. This allows data transfer to occur through optimized paths without competing for resources during normal I/O operations, preventing performance degradation while enabling continuous transfer processing. The dedicated paths are prepared in advance to handle the transfer workload separately.
Solution Approach 2:
The patent introduces an intermediary mechanism in the form of dedicated connecting paths that mediate between I/O nodes for data transfer operations. This intermediary path separates transfer traffic from regular I/O traffic, allowing both operations to proceed simultaneously without interference. The dedicated path acts as a specialized channel that handles transfer processing without burdening the general I/O processing system.
3Device complexity
If I/O node is used for both application operation and data transfer, then system simplicity is maintained, but resource competition occurs causing performance degradation
Solution Approach 1:
The patent segments the system architecture to separate I/O nodes into different functional groups: some dedicated to application operations and others dedicated to data transfer operations. This segmentation eliminates resource competition by assigning distinct roles to different I/O nodes, maintaining high processing throughput while preserving reasonable architectural simplicity through clear functional separation.
Solution Approach 2:
The patent implements universality by enabling I/O nodes to perform multiple functions depending on their role: application-processing I/O nodes handle user workloads while transfer-processing I/O nodes handle data migration. Each node type is optimized for its specific function, but the overall system achieves multi-functionality through the combination of different node types working together in the segmented architecture.
Data Source
AI summary
A converged system and migration method capable of preventing system performance degradation with respect to data transfer is proposed. A first calculation node continues executing I/O processing in response to an I/O request from an application; and, upon execution of the I/O processing, the first calculation node issues an I/O processing event notice indicating a transfer status of data on which the I/O processing has been executed. When receiving a migration command from a migration management unit, a second calculation node judges whether or not data stored in a first I/O node is data which should be transferred, based on the I/O processing event notice; and then transfers the data, which should be transferred, to a third calculation node.