DPU Virtual Machine Startup via Host-Offloaded VM Managers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Concurrent starting of multiple virtual machines in existing systems is time-consuming and fails to meet user demands for rapid capacity expansion due to communication bottlenecks and CPU limitations in data processing units (DPU).

Innovation Solution

Create virtual machine managers on a host with abundant CPU resources to start virtual machines concurrently, then offload these managers to the DPU for management once the process is complete, reducing load pressure and interaction between host and DPU.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If virtual machine managers are created on the DPU to start virtual machines concurrently, then the management of virtual machines is centralized on the DPU, but the starting speed of multiple virtual machines becomes too slow to meet user demands for rapid capacity expansion

Engineering Contradiction:
Improvecentralized management on DPUVSAvoidstarting speed of virtual machines
Core Design Contradiction:
Extent of automationVSProductivity

Solution Approach 1:

The patent introduces the host system as an intermediary during the virtual machine starting phase. The DPU creates virtual machine managers on the host, which then start multiple virtual machines concurrently using host CPU resources. After starting, the managers are transferred back to the DPU. This intermediary approach allows rapid concurrent starting while maintaining eventual centralized management on the DPU.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If multiple virtual machine managers are created on the host to start virtual machines concurrently, then the starting efficiency is improved, but the load pressure on the host increases

Engineering Contradiction:
Improvestarting efficiency of virtual machinesVSAvoidload pressure on host
Core Design Contradiction:
ProductivityVSStress or pressure

Solution Approach 1:

The patent applies preliminary action by creating virtual machine managers on the host temporarily just for the purpose of starting virtual machines. The managers are created, used to start the virtual machines, and then transferred to the DPU before the host needs to handle other tasks. This temporary use of host resources improves starting efficiency while limiting the duration of increased load pressure.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If virtual machine managers are created and started on the host, then rapid capacity expansion is achieved, but the interaction and data transfer between host and DPU increase

Engineering Contradiction:
Improvecapacity expansion speedVSAvoiddata transfer time between host and DPU
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent rushes through the data transfer process by creating virtual machine managers on the host, having them start virtual machines concurrently, and then quickly transferring the managers back to the DPU. The entire sequence is optimized to complete rapidly, skipping through the intermediate state where managers exist on the host. This minimizes the time loss associated with data transfer while achieving rapid capacity expansion.

Inventive Principle:
Principle #21Skipping (Rushing through)

Data Source

PatentEP4671980A1Method and device for controlling starting of virtual machine based on data processing unit
Publication Date: 2025.12.31 BEIJING VOLCANO ENGINE TECH CO LTD
  • EP4671980A1 patent drawingFigure 1~2
  • EP4671980A1 patent drawingFigure 3~4
  • EP4671980A1 patent drawingFigure 5~6

AI summary

The embodiments of the present disclosure provide a method and a device for controlling a starting of a virtual machine based on a data processing unit, DPU. The method comprises: sending (S301), in response to receiving an instruction for starting a plurality of virtual machines by the DPU, an instruction for creating a plurality of virtual machine managers to a host to which the DPU belongs, wherein one virtual machine manager is configured to manage one virtual machine; creating (S302) a plurality of virtual machine managers by the host, and concurrently starting a plurality of virtual machines by the virtual machine managers using a resource on the host; and offloading (S303), in response to a completion of concurrently starting the virtual machines, the virtual machine managers from the host to the DPU, and managing the started virtual machines by the virtual machine managers using a resource on the DPU.