Live VM Migration via Domain-Based ASIC State Serialization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The complexity of application-specific integrated circuits (ASICs) in artificial intelligence systems hinders effective live migration, particularly in the processes of serialization and deserialization during virtual machine migration.

Innovation Solution

A system and method for live migration involving a read-only memory (ROM) with firmware that virtualizes physical functions, utilizing serializers and deserializers to manage data structures with domain identifiers, enabling efficient serialization and deserialization of information across servers.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If live migration is implemented in AI systems with complex ASICs, then virtual machine mobility is achieved, but serialization and deserialization processes become overly complex

Engineering Contradiction:
Improvevirtual machine mobilityVSAvoidserialization and deserialization complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a domain identifier as an intermediary element that mediates between the complex ASIC hardware and the virtual machine migration process. This domain identifier serves as a standardized interface that simplifies the serialization and deserialization operations, allowing virtual machines to be migrated without directly managing the underlying ASIC complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the migration process by introducing structured data formats with distinct protocol layers. The migration data is divided into manageable components including domain identifiers, protocol layers, and structured fields, which can be independently serialized and deserialized. This segmentation reduces the overall complexity by breaking down the monolithic migration task into smaller, more manageable units.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If detailed information is serialized during live migration, then migration accuracy is improved, but data processing time increases

Engineering Contradiction:
Improvemigration accuracyVSAvoiddata processing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by pre-defining structured data formats and protocol layers before the actual migration process. The domain identifiers and data structures are prepared in advance, allowing the serialization process to efficiently encode information without ad-hoc processing. This pre-preparation ensures accuracy while reducing processing time during the actual migration execution.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If complex data structures are used to represent virtual machine state, then migration completeness is improved, but deserialization difficulty increases

Engineering Contradiction:
Improvemigration completenessVSAvoiddeserialization difficulty
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments complex virtual machine state into structured data formats with clear protocol layers. Each aspect of the virtual machine state is represented as a distinct structured field with defined formats, making the deserialization process more manageable. The domain identifier further segments the data by indicating the specific virtual function or hardware domain, reducing deserialization difficulty while maintaining completeness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms complex virtual machine state into standardized parameter representations within the structured data format. By converting diverse hardware states into uniform parameter structures with defined protocols, the system maintains migration completeness while significantly reducing deserialization complexity. The domain identifier acts as a parameter that guides the deserialization process.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12547313B2Device and method for implementing live migration
Publication Date: 2026.02.10 CAMBRICON (XIAN) SEMICON CO LTD
  • US12547313B2 patent drawing
  • US12547313B2 patent drawing
  • US12547313B2 patent drawing

AI summary

The present disclosure relates to a device and a method for implementing live migration, where an on-chip system of the present disclosure is comprised in an integrated circuit apparatus, which comprises a general interconnection interface and other processing apparatuses. The computation apparatus interacts with other processing apparatuses to jointly complete computing operations specified by users. The integrated circuit apparatus also comprises a storage apparatus. The storage apparatus is respectively connected to the computation apparatus and other processing apparatuses and is used for storing data of the computation apparatus and other processing apparatuses.