Dynamic Scheduling for Cloud Virtualized Resource Migration

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Cloud-based networks face challenges in efficiently migrating virtualized resources between availability zones and edge locations while minimizing latency and ensuring data integrity, particularly due to limitations in bandwidth and network connectivity.

Innovation Solution

The implementation of a secure data tunnel for migrating virtualized resources, utilizing a pre-copy and post-copy process to transfer data, where frequently accessed data is pre-copied and less accessed data is post-copied, along with scheduling migrations during idle times to optimize bandwidth usage and ensure continuous operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If virtualized resources are migrated over external networks with limited bandwidth, then data transfer completes, but migration time increases and service interruption occurs

Engineering Contradiction:

Improvemigration speedVSAvoidservice interruption time

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-copying frequently accessed data blocks before the actual migration event. This allows the migration process to start with critical data already transferred, reducing the time required during the migration window and minimizing service interruption.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The migration process is segmented into different phases: pre-copy phase for frequently accessed data, and post-copy phase for less accessed data. This segmentation allows prioritization of critical data transfer and enables the migration to proceed in stages, reducing overall interruption time.

Inventive Principle:

Principle #1Segmentation

2Reliability

If all data is pre-copied during migration, then data transfer is complete, but bandwidth consumption increases and migration scheduling becomes difficult

Engineering Contradiction:

Improvedata transfer completenessVSAvoidbandwidth consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

Different data blocks are treated differently based on their access characteristics. Frequently accessed data blocks receive priority pre-copy treatment, while less accessed blocks are handled during post-copy. This local quality differentiation optimizes bandwidth usage by focusing resources on critical data.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

Instead of pre-copying all data, the system performs partial pre-copying only for frequently accessed data blocks. This partial action approach reduces bandwidth consumption during the pre-copy phase while still ensuring critical data is transferred, balancing reliability with resource efficiency.

Inventive Principle:

Principle #16Partial or excessive action

3Productivity

If migration is performed during active usage, then continuous service is maintained, but data access latency increases and data integrity may be compromised

Engineering Contradiction:

Improveservice continuityVSAvoiddata access latency

Core Design Contradiction:

ProductivityVSLoss of information

Solution Approach 1:

The system creates a copy of frequently accessed data blocks and places it in a buffer before migration. This copying mechanism allows the target host to serve data from the buffer during migration, maintaining service continuity while reducing access latency compared to real-time transfer.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

Data blocks are preliminarily copied and buffered before the migration event. This preliminary action ensures that when migration occurs, the data is already prepared and can be accessed with minimal latency, maintaining service continuity without compromising data access performance.

Inventive Principle:

Principle #10Preliminary action

4Reliability

If secure tunneling is used for external network migration, then data security is improved, but network overhead increases and transfer speed decreases

Engineering Contradiction:

Improvedata securityVSAvoidtransfer speed

Core Design Contradiction:

ReliabilityVSSpeed

Solution Approach 1:

Data blocks are pre-processed and prepared for secure transmission in advance. This preliminary action includes formatting and encryption preparation, allowing the actual secure transfer to be more efficient and reducing the overall impact of security overhead on transfer speed.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11573839B1Dynamic scheduling for live migration between cloud regions and edge locations

Publication Date: 2023.02.07 AMAZON TECH INC

AI summary

This disclosure describes systems, devices, and techniques for migrating virtualized resources between the main region and edge locations. Live migration enables virtualized resources to remain operational during migration. Edge locations are typically separated from secure data centers via the Internet, a direct connection, or some other intermediate network. Accordingly, to place virtualized resources within an edge location, the virtualized resources must be migrated over a secure communication tunnel that can protect virtualized resource data during transmission over the intermediate network. The secure communication tunnel may have limited data throughput. To efficiently utilize resources of the secure communication tunnel, and to reduce the impact of migrations on virtualized resource operations, virtualized resource migrations may be carefully scheduled in advance. For instance, virtualized resources may be selectively migrated at times-of-day in which they are likely to be relatively idle, or at times when the communication tunnel is predicted to have sufficient bandwidth.