Live VM Migration via Domain-Based ASIC State Serialization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The complexity of application-specific integrated circuits (ASICs) in artificial intelligence systems hinders effective live migration, particularly in the processes of serialization and deserialization during virtual machine migration.
Innovation Solution
A system and method for live migration involving a read-only memory (ROM) with firmware that virtualizes physical functions, utilizing serializers and deserializers to manage data structures with domain identifiers, enabling efficient serialization and deserialization of information across servers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If live migration is implemented in AI systems with complex ASICs, then virtual machine mobility is achieved, but serialization and deserialization processes become overly complex
Solution Approach 1:
The patent introduces a domain identifier as an intermediary element that mediates between the complex ASIC hardware and the virtual machine migration process. This domain identifier serves as a standardized interface that simplifies the serialization and deserialization operations, allowing virtual machines to be migrated without directly managing the underlying ASIC complexity.
Solution Approach 2:
The patent segments the migration process by introducing structured data formats with distinct protocol layers. The migration data is divided into manageable components including domain identifiers, protocol layers, and structured fields, which can be independently serialized and deserialized. This segmentation reduces the overall complexity by breaking down the monolithic migration task into smaller, more manageable units.
2Manufacturing precision
If detailed information is serialized during live migration, then migration accuracy is improved, but data processing time increases
Solution Approach 1:
The patent applies preliminary action by pre-defining structured data formats and protocol layers before the actual migration process. The domain identifiers and data structures are prepared in advance, allowing the serialization process to efficiently encode information without ad-hoc processing. This pre-preparation ensures accuracy while reducing processing time during the actual migration execution.
3Reliability
If complex data structures are used to represent virtual machine state, then migration completeness is improved, but deserialization difficulty increases
Solution Approach 1:
The patent segments complex virtual machine state into structured data formats with clear protocol layers. Each aspect of the virtual machine state is represented as a distinct structured field with defined formats, making the deserialization process more manageable. The domain identifier further segments the data by indicating the specific virtual function or hardware domain, reducing deserialization difficulty while maintaining completeness.
Solution Approach 2:
The patent transforms complex virtual machine state into standardized parameter representations within the structured data format. By converting diverse hardware states into uniform parameter structures with defined protocols, the system maintains migration completeness while significantly reducing deserialization complexity. The domain identifier acts as a parameter that guides the deserialization process.
Data Source
AI summary
The present disclosure relates to a device and a method for implementing live migration, where an on-chip system of the present disclosure is comprised in an integrated circuit apparatus, which comprises a general interconnection interface and other processing apparatuses. The computation apparatus interacts with other processing apparatuses to jointly complete computing operations specified by users. The integrated circuit apparatus also comprises a storage apparatus. The storage apparatus is respectively connected to the computation apparatus and other processing apparatuses and is used for storing data of the computation apparatus and other processing apparatuses.


