Parallel Volume Data Transfer Using Dynamic Resource Allocation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data transfer processes, particularly in hybrid cloud environments, are inefficient due to insufficient bandwidth utilization and lack of dynamic resource allocation, leading to prolonged transfer times, especially with increased data volumes.
Innovation Solution
A system and method that involves activating multiple computer resources to mount and process a common volume in parallel, allocating data transfer processes to each storage region, and dynamically adjusting resource configuration based on transfer requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single data mover is used to transfer data in a volume-to-volume manner, then the data transfer process is simplified, but the data transfer speed is insufficient when dealing with large volume sizes
Solution Approach 1:
The patent divides a single volume into multiple storage regions and assigns each region to a separate data mover, enabling parallel data transfer operations. This segmentation allows the system to maintain simplified volume-to-volume transfer semantics while achieving higher throughput through multiple concurrent transfer channels.
Solution Approach 2:
The patent combines multiple data movers to work collectively on a single volume transfer operation. By mounting the same volume on multiple data movers simultaneously and coordinating their operations, the system achieves aggregated transfer speeds that exceed what a single data mover could provide.
2Adaptability or versatility
If broadband storage is used as transfer destination or source, then storage capacity and accessibility are improved, but the bandwidth cannot be fully utilized by a single computer resource
Solution Approach 1:
The patent segments the broadband storage access across multiple data movers, with each data mover handling specific storage regions. This allows the system to fully utilize the available bandwidth by distributing I/O operations across multiple concurrent access paths to the same broadband storage resource.
Solution Approach 2:
The patent enables a single broadband storage resource to serve multiple data movers simultaneously, making the storage system universal and multi-functional. The same storage infrastructure is shared across multiple compute resources, maximizing resource utilization and eliminating bandwidth bottlenecks.
3Stability of the object's composition
If fixed computer resource configuration is used for data transfer, then system stability is maintained, but the configuration cannot be adjusted according to volume size or transfer speed requirements
Solution Approach 1:
The patent implements dynamic resource allocation where the number of data movers activated for a volume transfer operation is determined based on the volume size and performance requirements. This allows the system to adapt its computational resources dynamically - activating more data movers for larger volumes or faster transfer needs, and fewer for smaller, less critical transfers.
Solution Approach 2:
The patent changes the operational parameters of the data transfer system by adjusting the number of active data movers based on volume characteristics. System administrators or automated policies can modify parameters such as the number of concurrent data movers, the size of storage regions assigned to each, and the mount configuration to optimize performance for different transfer scenarios.
Data Source
AI summary
When executing a data transfer process between one volume and a second storage unit, a computer resource activation unit activates one or more computer resources that executes the data transfer process, and mounts one common volume as a transfer source or a transfer destination in the data transfer process on any of the activated computer resources. A region allocation unit allocates a part of the data transfer process to the computer resource for each storage region. The computer resource executes the part of the data transfer process between the second storage unit and the storage region allocated to the computer resource in the one common volume.