APU Virtual EDPA Interfaces for Multi-Host Accelerator Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing complexity and number of hardware elements in artificial intelligent processing units (APUs) necessitate multiple external data processing accelerators (EDPAs), leading to higher hardware costs due to direct connections requiring additional EDPAs.

Innovation Solution

Implementing virtual engine hardware interfaces (EDPA interfaces) that simulate a higher number of EDPAs than actual EDPAs, allowing fewer EDPAs to meet communication and system requirements by configuring EDPA interfaces to manage multiple hosts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If direct connections between hosts and EDPAs are implemented, then communication requirements are met, but hardware cost increases due to needing more EDPAs

Engineering Contradiction:
Improvecommunication requirement fulfillmentVSAvoidhardware cost
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces virtual EDPAs as intermediary entities between hosts and physical EDPAs. These virtual EDPAs are software-based simulations that mediate communication requests, allowing multiple hosts to access fewer physical EDPAs through virtualization. The virtual EDPAs manage the mapping and routing of communication requests from multiple hosts to the available physical EDPAs, reducing the total number of physical EDPAs needed while maintaining communication requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates virtual copies of EDPAs through software simulation. Instead of requiring one physical EDPA per host, the system creates virtual instances of EDPAs that can be allocated to multiple hosts. These virtual copies simulate the functionality of physical EDPAs, allowing hosts to communicate as if dedicated EDPAs existed, while in reality, fewer physical EDPAs are shared among multiple hosts through the virtualization layer.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If multiple EDPAs are added to meet system requirements, then functionality is improved, but hardware cost increases

Engineering Contradiction:
Improvesystem functionalityVSAvoidnumber of EDPAs
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent makes physical EDPAs universal by introducing virtual EDPAs that allow a single physical EDPA to serve multiple hosts simultaneously. The virtualization layer enables one physical EDPA to be shared across multiple virtual instances, each appearing as a dedicated resource to its host. This multi-functionality approach allows the same physical hardware to fulfill multiple communication requirements, reducing the total quantity of EDPAs needed while maintaining or enhancing system adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements dynamic allocation of virtual EDPAs to hosts based on system requirements and resource availability. The virtualization layer can dynamically create, allocate, and manage virtual EDPA instances, allowing the system to adapt to changing functionality requirements without adding physical hardware. This dynamic approach enables the system to provide enhanced adaptability and versatility while controlling the quantity of physical EDPAs through flexible, software-based resource management.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250390327A1APU virtual engine hardware interface
Publication Date: 2025.12.25 MEDIATEK INC
  • US20250390327A1 patent drawing
  • US20250390327A1 patent drawing
  • US20250390327A1 patent drawing

AI summary

In an aspect of the disclosure, an artificial intelligent processing unit (APU) is provided. The APU comprises multiple hosts, multiple external data processing accelerator (EDPA) interfaces respectively coupled to the multiple hosts, and at least one EDPA optionally coupled to the multiple EDPA interfaces. The multiple EDPA interfaces are configured as interfaces between the multiple hosts and the at least one EDPA, and the number of the EDPA interfaces is more than the number of the at least one EDPAs.