Staged Data Migration via Edge Intermediary Service
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Migrating large-scale data from premise networks to cloud-based storage networks over public Internet connections is impractical due to slow transfer speeds, lack of security, and limited bandwidth, making it difficult to manage and secure the data transfer process.
Innovation Solution
Implementing a staged data migration system with an intermediary data distribution service installed at the network edge, using dedicated high-bandwidth connections to facilitate faster and more secure data transport between premise data sources and host storage clouds, allowing for error correction and enhanced management controls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If public Internet connections are used for data migration, then connectivity and accessibility are improved, but transfer speed and bandwidth are insufficient
Solution Approach 1:
The patent introduces a data distribution service as an intermediary component deployed at the network edge, which acts as a mediator between the data source and cloud storage. This intermediary establishes dedicated high-bandwidth connections to enable fast data migration while keeping the public Internet connection requirements minimal, thus resolving the contradiction between transfer speed and network infrastructure complexity.
2Productivity
If dedicated high-bandwidth connections are used, then data transfer speed is improved, but connection complexity and management overhead increase
Solution Approach 1:
The data distribution service implements self-service capabilities by automatically discovering available bandwidth, negotiating connection parameters, and managing the data migration process without requiring complex manual configuration. The service autonomously handles connection establishment, data staging, and transfer coordination, thereby achieving high productivity while minimizing connection management complexity.
3Loss of time
If data is staged at network edge, then transfer time is reduced, but infrastructure requirements increase
Solution Approach 1:
The system performs preliminary actions by staging data at the network edge before the actual cloud migration occurs. The data distribution service pre-processes and positions data closer to the destination, performing initial data preparation and buffering operations that reduce the time required for the final high-speed transfer to cloud storage, thus minimizing data transfer time while keeping edge infrastructure requirements manageable.
Data Source
AI summary
Embodiments relate to systems and methods for staged data migration between data sources and a cloud-based storage network. In aspects, a user can maintain a user premise network including servers, clients, local area networks, data stores, and/or other network assets. An administrator or other user of the premise network may wish to extract data from the premise network and transfer that data payload to a set of host storage clouds to leverage cost, redundancy, consolidation, or other cloud advantages. A cloud data delivery (CDD) service can be established to stage the upload of the data payload to the set of host storage clouds using a set of managed or dedicated lines to the CDD service, and to the host storage clouds at network edge. The connections between the premise network/CDD service and CDD service/host storage clouds can be selected and/or optimized to provide high-bandwidth connections tailored to the schedule, cost, or other requirements of the data payload to be transported.