DMA Write Record Buffer for Virtual Machine State Replication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtualization technologies face challenges in efficiently replicating the state of virtual machines during live migration and maintenance, particularly due to the difficulty in tracking memory changes made by DMA-capable devices that bypass the virtualization management software.

Innovation Solution

The implementation of DMA write records allows virtualization management components to identify and replicate memory regions modified by DMA-capable devices by storing and managing these records in buffers, enabling the VMC to control the rate of DMA writes and ensure accurate state replication during migration and maintenance operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If DMA-capable devices bypass the virtualization management software to write directly to physical memory, then the speed of data transfer is improved, but the ability to track and replicate memory changes deteriorates

Engineering Contradiction:
Improvedata transfer speedVSAvoidmemory change tracking information
Core Design Contradiction:
SpeedVSLoss of information

Solution Approach 1:

The patent introduces a DMA capture device as an intermediary component between the DMA-capable device and physical memory. This capture device monitors and records memory addresses accessed by DMA operations without interfering with the high-speed data transfer. The recorded address information is then provided to the virtualization management software, enabling it to track memory changes despite the DMA bypass path.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the virtualization management software tracks all memory changes for state replication, then the accuracy of state replication is improved, but the processing overhead and complexity increase

Engineering Contradiction:
Improvestate replication accuracyVSAvoidtracking system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts the memory change tracking function from the virtualization management software and assigns it to a dedicated DMA capture device. This separation allows the VMC to focus on state replication logic while the capture device handles the specialized task of monitoring DMA memory accesses, reducing the overall system complexity and processing overhead.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The DMA capture device autonomously monitors and records memory address information from DMA operations without requiring active intervention from the virtualization management software. The device self-manages the capture and recording of relevant memory changes, providing information to the VMC only when needed for state replication.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If DMA write operations are throttled to allow proper tracking and replication, then the accuracy of state replication is improved, but the productivity of DMA operations decreases

Engineering Contradiction:
Improvestate replication accuracyVSAvoidDMA operation throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent implements preliminary tracking of DMA memory accesses by the capture device before state replication is needed. By continuously monitoring and recording memory address information in advance, the system prepares the necessary data for replication without interrupting or throttling DMA operations, maintaining both accuracy and productivity.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10198377B2Virtual machine state replication using DMA write records
Publication Date: 2019.02.05 AMAZON TECH INC
  • US10198377B2 patent drawing
  • US10198377B2 patent drawing
  • US10198377B2 patent drawing

AI summary

A DMA-capable device of a virtualization host stores a DMA write record, indicating a portion of host memory that is targeted by a DMA write operation, in a write buffer accessible from a virtualization management component of the host. The virtualization management component uses the DMA write record to identify a portion of memory to be copied to a target location to save a representation of a state of a particular virtual machine instantiated at the host.