VM Data Migration Tag Buffering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

During live migration of virtual machine instances, the efficient transfer of metadata, such as Memory Tagging Extension (MTE) bits, along with VM instance data is hindered by the need for separate memory accesses and limited I/O bus width, leading to degraded system performance and increased bandwidth usage.

Innovation Solution

Implementing a tag buffer accessible by the I/O device to temporarily store tag data, allowing for simultaneous read and write operations with VM instance data, thereby facilitating efficient data migration by using address aliases and specific bus device functions to manage data migration commands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If separate memory accesses are used to read VM instance data and tag data, then data migration can be performed, but system performance degrades and bandwidth usage increases

Engineering Contradiction:
Improvedata migration efficiencyVSAvoidmemory access time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent merges the reading of VM instance data and tag data into a single memory access operation. The memory controller is configured to read both the VM instance data and the corresponding tag data together in one operation, eliminating the need for separate memory accesses. This combining approach reduces the total number of memory accesses, decreases time loss, and improves overall data migration efficiency without increasing bandwidth requirements.

Inventive Principle:
Principle #5Merging (Combining)

2Loss of information

If tag data is transferred alongside VM instance data, then metadata migration is complete, but I/O bus width limitations cause performance degradation

Engineering Contradiction:
Improvemetadata transfer completenessVSAvoidmigration speed
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent implements preliminary action by having the memory controller prepare and organize the tag data in advance during the memory read operation. The tag data is read and prepared alongside the VMinstance data in a coordinated manner, so that when the data is transferred via the I/O bus, both datasets are already organized and ready for efficient transmission. This preliminary preparation allows the I/O bus to transmit both data types effectively without being constrained by its width limitations, maintaining both completeness and speed.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12197938B1Data migration with metadata
Publication Date: 2025.01.14 AMAZON TECH INC
  • US12197938B1 patent drawing
  • US12197938B1 patent drawing
  • US12197938B1 patent drawing

AI summary

An input/output (I/O) device can initiate data migration of a virtual machine (VM) instance from a source device to a target device. The data migration of the VM instance may include migrating the data for the VM instance and tag data associated with the data. The data for the VM instance and the tag data may be stored together in a source memory. A first read request from the I/O device can enable a memory controller in the source device to read the data for the VM instance and the tag data together, store the tag data in a tag data buffer, and transmit the data for the VM instance to the target device. A second read request from the I/O device can read the stored tag data from the tag data buffer and transmit to the target device. The target device can write the data for the VM instance together with the tag data in the target memory.