Data Migration via Multi-Asset Chunk Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data protection systems, such as tape backup drives and data replication, face inefficiencies in migrating data between storage arrays, particularly when multiple assets with varying bandwidths are involved, and lack optimal asset selection based on performance.
Innovation Solution
A method and apparatus that migrate data from one device to another using multiple assets, where assets are selected and assigned based on performance, utilizing a work buffer to manage chunk transfers and notify successful copying, enabling concurrent data migration across storage arrays without direct access to all devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If conventional data replication systems are used, then data protection is achieved, but migration efficiency is reduced due to single-asset limitations
Solution Approach 1:
The patent segments the data migration task into multiple chunks and assigns different chunks to different assets (storage devices, networks, hosts) to perform simultaneously. This parallel processing approach divides the single-asset sequential migration into multi-asset concurrent operations, significantly improving migration efficiency and reducing total migration time.
Solution Approach 2:
The patent merges multiple assets (storage devices, networks, hosts) into a coordinated migration system where multiple assets work together on a single migration task. By combining the capabilities of multiple assets and managing them through a work buffer, the system achieves higher throughput and faster migration compared to conventional single-asset approaches.
2Productivity
If multiple assets are used for migration, then transfer speed increases, but asset selection and management complexity increases
Solution Approach 1:
The patent introduces a work buffer as an intermediary component that manages multiple assets and coordinates their operations. The work buffer receives migration requests, selects appropriate assets based on availability and performance, assigns data chunks to assets, and tracks migration progress. This intermediary simplifies the complexity of managing multiple assets by providing a centralized control mechanism.
Solution Approach 2:
The patent dynamically changes asset selection based on varying parameters such as asset availability, bandwidth conditions, and migration progress. The system monitors asset performance and adjusts chunk assignment in real-time, optimizing the use of multiple assets throughout the migration process rather than using fixed asset assignments.
3Adaptability or versatility
If assets with varying bandwidths are used, then migration flexibility improves, but chunk assignment optimization becomes more difficult
Solution Approach 1:
The patent implements dynamic chunk assignment where the work buffer continuously monitors asset bandwidth performance and adjusts chunk size and assignment in real-time. Assets with higher bandwidth receive larger chunks or more chunks simultaneously, while lower-bandwidth assets receive smaller chunks. This dynamic adaptation optimizes the use of assets with varying bandwidths and improves overall migration efficiency.
Data Source
AI summary
In one aspect, a method includes migrating a first device on a first array to a second device on a second storage array. The migrating includes instructing an asset to scan the first array and the second array for the first device and the second device, reading a work buffer on the second array, sending a request to the work buffer for a chunk of the first device to copy to the second device, reading assigned chunk from the first device, copying the assigned chunk to the second device and notifying the work buffer that the copying of the assigned chunk was successful.