Gen-Z Vendor-Defined Extended Instructions for Matrix Operations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Gen-Z interface technology does not support complex instructions for operations such as linear algebra and matrix operations, which are essential for large-scale operations in machine learning, despite its development for next-generation memory control.

Innovation Solution

The implementation of vendor-defined extended instructions based on the Gen-Z interface standard, including instructions for multiplication, division, shifting, matrix operations, and others, which are transmitted and processed between devices using the Gen-Z interface, enhancing the instruction set to support large-scale data operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the Gen-Z interface uses only standard instructions, then the interface complies with the Gen-Z standard, but it cannot support complex operations such as linear algebra and matrix operations

Engineering Contradiction:
Improveinstruction set capabilityVSAvoidinstruction set complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The instruction set is segmented into standard Gen-Z instructions and vendor-defined extended instructions. The extended instructions are further segmented into specific operation types (multiplication, division, shifting, matrix operations) with dedicated opcode ranges, allowing complex operations to be broken down into manageable instruction segments that can be processed efficiently

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Vendor-defined extended instructions act as an intermediary layer between the standard Gen-Z interface and complex computational operations. These extended instructions translate high-level mathematical operations into standardized interface commands, enabling complex linear algebra and matrix operations while maintaining compliance with the Gen-Z interface standard

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If CPU processes all operations, then instruction compatibility is maintained, but system bandwidth and processing speed are limited

Engineering Contradiction:
Improveprocessing speedVSAvoidsystem architecture complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Complex computational operations are extracted from the CPU and delegated to the Gen-Z interface through vendor-defined extended instructions. This extraction allows the CPU to focus on control flow and memory management while specialized operations are handled by the interface layer, improving overall system bandwidth and processing speed

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The Gen-Z interface is designed with multi-functionality to handle both standard memory operations and complex computational operations. By incorporating vendor-defined extended instructions that support multiplication, division, shifting, and matrix operations, the interface becomes a universal platform that can perform diverse operations without requiring separate dedicated hardware for each function

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11366661B2Method for generating and processing extended instruction and apparatus using the method
Publication Date: 2022.06.21 ELECTRONICS & TELECOMM RES INST
  • US11366661B2 patent drawing
  • US11366661B2 patent drawing
  • US11366661B2 patent drawing

AI summary

A method for generating and processing extended instructions and an apparatus using the method are provided. The method includes: transmitting, by a first device, a request packet according to an extended instruction that is generated based on a Gen-Z interface standard to a second device; and receiving, by the first device, a response packet including a result of performing the request packet from the second device. The extended instruction is generated based on a vendor-defined instruction set of the Gen-Z interface.