Virtual Function Migration with SR-IOV PCIe State Preservation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Migrating virtual machines (VMs) between hosts is a slow and cumbersome process due to the need to deallocate and reallocate virtual functions (VFs) on PCIe cards, which are not part of the VMs, leading to bottlenecks and inefficiencies in network access and storage connectivity.

Innovation Solution

Implementing SR-IOV capable PCIe devices that allow for the configuration of virtual functions (VFs) to be migrated with the VMs, preserving their state and maintaining network and storage connections, enabling quicker and more efficient VM migrations by using software-defined network and NVMe interfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If VMs are migrated between hosts by deallocating and reallocating VFs on PCIe cards, then VM migration can be achieved, but the migration process becomes slow and cumbersome due to connection reestablishment requirements

Engineering Contradiction:
ImproveVM migration speedVSAvoidMigration time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent merges the VM migration process with the VF state preservation and transfer. By capturing the VF state (including PCIe configuration space, BAR regions, and device-specific registers) as part of the VM image and restoring it on the destination host, the VF is effectively moved along with the VM. This eliminates the traditional approach of deallocating VFs on the source host and reallocating them on the destination host, thereby avoiding connection reestablishment delays and significantly improving migration speed.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If VFs are deallocated and reallocated during VM migration, then VMs can move between hosts, but network and storage connections must be reestablished causing bottlenecks and inefficiencies

Engineering Contradiction:
ImproveVM mobilityVSAvoidNetwork and storage access efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent performs preliminary action by capturing and preserving the VF state (including PCIe configuration space, BAR regions, and device-specific registers) before VM migration. This state data is embedded in the VM image and restored on the destination host before the VM resumes operation. By preparing the VF state in advance and ensuring it is properly restored, the system maintains network and storage connections without requiring reestablishment, thus avoiding bottlenecks and inefficiencies while enabling VM mobility.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If traditional VM migration is performed without VF state preservation, then migration can be completed, but the process is cumbersome and requires manual intervention for connection reestablishment

Engineering Contradiction:
ImproveMigration operation simplicityVSAvoidConnection reestablishment time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent implements self-service by automating the entire VF state preservation and restoration process. The hypervisor automatically captures the VF state (PCIe configuration space, BAR regions, device-specific registers) when the VM is migrated, embeds it in the VM image, and restores it on the destination host without requiring manual intervention. This automation eliminates the need for operators to manually reestablish network and storage connections, significantly improving ease of operation and reducing connection reestablishment time.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11740920B2Methods and systems for migrating virtual functions in association with virtual machines
Publication Date: 2023.08.29 PENSANDO SYSTEMS INC
  • US11740920B2 patent drawing
  • US11740920B2 patent drawing
  • US11740920B2 patent drawing

AI summary

Virtual functions (VFs) running on SR-IOV (single root IO virtualization) capable PCIe devices can migrate in association with VMs using the VFs. A SR-IOV capable PCIe device installed in a host computer can implement the VFs. A VM running on the host and associated with the VF can use the VF to obtain a service such as network communications or access to a NAS device. Migrating the VF in association with the VM can include halting the VM in a VM state on the host, halting the VF in a PCIe state and then obtaining a PCIe state data, restarting the VF in the PCIe state on a second PCIe device of a second host based on the PCIe state data, and restarting the VM in the VM state on the second host, wherein the VM is configured to use the VF on the second PCIe device.