Live Migration Scheduling for Virtualized Resources

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud-based networks face challenges in efficiently migrating virtualized resources between availability zones and edge locations while minimizing latency and ensuring data integrity, particularly due to limitations in bandwidth and network connectivity, which can impact user experience in applications like gaming.

Innovation Solution

The implementation of a secure data tunnel for migrating virtualized resources, utilizing a pre-copy and post-copy process to transfer data efficiently, and scheduling migrations based on utilization levels and network conditions to optimize bandwidth usage, along with ensuring block storage data integrity through replica management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtualized resources are migrated over external networks with limited bandwidth, then data transfer completes, but migration latency increases and user experience deteriorates

Engineering Contradiction:
Improvedata transfer completionVSAvoidmigration latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the data transfer process into two distinct phases: pre-copy phase where data is transferred before migration, and post-copy phase where data is transferred after migration. This segmentation allows the system to optimize each phase independently - pre-copy can use compression and prioritization for frequently accessed data, while post-copy handles remaining data with different strategies, thereby reducing overall migration latency despite bandwidth constraints

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The pre-copy phase performs preliminary data transfer and optimization before the actual migration occurs. During this phase, the system identifies and prioritizes frequently accessed data blocks, applies compression algorithms, and prepares data for efficient transfer. This preliminary action ensures that critical data is ready before migration, minimizing the impact on user experience during the actual migration event

Inventive Principle:
Principle #10Preliminary action

2Reliability

If pre-copy process transfers all data blocks, then data completeness is ensured, but network bandwidth is exhausted and migration time increases

Engineering Contradiction:
Improvedata completenessVSAvoidmigration efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies partial action by transferring only the most critical data blocks during the pre-copy phase - specifically frequently accessed data identified through monitoring. Not all data blocks are pre-copied; instead, the system selectively prioritizes data based on access patterns. This partial pre-copy approach ensures data completeness over time while optimizing network bandwidth usage and reducing pre-copy duration, thereby improving overall migration efficiency

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If migration is performed during high utilization periods, then service continuity is maintained, but network bandwidth availability decreases and transfer speed slows

Engineering Contradiction:
Improveservice continuityVSAvoiddata transfer speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The patent implements dynamic migration scheduling that adapts to changing system conditions. The system continuously monitors utilization levels, network bandwidth availability, and data access patterns, then dynamically adjusts migration timing and data prioritization strategies. During high utilization periods, migration is scheduled during low-utilization intervals identified through monitoring, and data prioritization dynamically adapts to current access patterns, ensuring both service continuity and acceptable transfer speeds

Inventive Principle:
Principle #15Dynamics

4Reliability

If secure tunneling is implemented for data transfer, then data security is improved, but network overhead increases and transfer efficiency decreases

Engineering Contradiction:
Improvedata securityVSAvoidtransfer efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies local quality by implementing selective security measures rather than uniform encryption for all data blocks. Frequently accessed data identified during pre-copy monitoring receives prioritized handling with optimized security processing, while less critical data uses standard security protocols. This localized approach to security - applying different security intensities to different data based on their criticality and access patterns - maintains strong security while reducing overall network overhead and improving transfer efficiency

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11461123B1Dynamic pre-copy and post-copy determination for live migration between cloud regions and edge locations
Publication Date: 2022.10.04 AMAZON TECH INC
  • US11461123B1 patent drawing
  • US11461123B1 patent drawing
  • US11461123B1 patent drawing

AI summary

This disclosure describes systems, devices, and techniques for live migrating virtualized resources between the main region and edge locations. Live migration enables virtualized resources to remain operational during migration. Edge locations are typically separated from secure data centers via the Internet, a direct connection, or some other intermediate network. Accordingly, to place virtualized resources within an edge location, the virtualized resources must be migrated over a secure communication tunnel that can protect virtualized resource data during transmission over the intermediate network. The secure communication tunnel may have limited data throughput. To efficiently utilize resources of the secure communication tunnel, virtualized resource data may be transferred over the tunnel in a two-stage process. The disclosed technology provides various techniques for dynamically selecting which virtualized resource data, and how much virtualized resource data, is transferred over each of the pre-copy and post-copy stages.