Apparatus and method used for executing matrix multiplication operation

A matrix operation and matrix multiplication technology, which is applied in the computer field, can solve the problems that inter-chip interconnect graphics processors cannot perform efficient matrix multiplication operations, a large amount of code, and limited register file design.

Active Publication Date: 2017-11-03
ANHUI CAMBRICON INFORMATION TECH CO LTD
View PDF3 Cites 74 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, according to this method, the existing special-purpose matrix operation device is limited by the design of the register file, and cannot flexibly support matrix operations of different lengths.
[0006] In summary, existing multi-core general-purpose processors on a chip, inter-chip interconnection general-purpose processors (single-core or multi-core

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Apparatus and method used for executing matrix multiplication operation
  • Apparatus and method used for executing matrix multiplication operation
  • Apparatus and method used for executing matrix multiplication operation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment approach

[0034] According to an embodiment of the present invention, the matrix multiplication operation device further includes: an instruction cache unit for storing matrix operation instructions to be executed. During the execution of the instruction, it is also cached in the instruction cache unit. When an instruction is executed, the instruction will be submitted.

[0035] According to an embodiment of the present invention, the control unit in the device further includes: an instruction queue module, configured to sequentially store the decoded matrix operation instructions, and after obtaining the scalar data required by the matrix operation instructions, Send matrix operation instructions and scalar data to the dependency processing module.

[0036] According to an embodiment of the present invention, the control unit in the device further includes: a dependency relationship processing unit, configured to determine whether there is a dependency relationship between the operatio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an apparatus and a method used for executing matrix multiplication operation. The apparatus is characterized by comprising a storage unit used for storing matrix data related with a matrix operation instruction, a register unit used for storing scalar data related with the matrix operation instruction, a control unit used for decoding the matrix operation instruction and controlling an operation process of the matrix operation instruction, and a matrix operation unit used for performing the matrix multiplication operation on an input matrix according to the decoded matrix operation instruction, wherein the matrix operation unit is a customized hardware circuit.

Description

technical field [0001] The present invention relates to the field of computers, and in particular, to a device and method for performing matrix multiplication operations. Background technique [0002] In the current computer field, with the maturity of emerging technologies such as big data and machine learning, more and more tasks include various matrix multiplication operations, especially large matrix multiplication operations, which often become the speed and effect of algorithms. Raised bottleneck. Take the current hot deep learning as an example, which includes a large number of matrix multiplication operations. In the fully connected layer of the artificial neural network of deep learning, the operation expression of the output neuron is y=f(wx+b), where w is the weight matrix, x is the input vector, b is the bias vector, and the output matrix is ​​calculated. The process of y is to multiply the matrix w by the vector x, add the vector b, and then perform the activa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F9/302
CPCG06F9/3001G06F17/16G06F9/30036G06F9/3836G06N3/08G06F7/78G06F9/3877G06F9/30032G06F15/8053G06F9/3557G06F9/355G06N3/045
Inventor 张潇刘少礼陈天石陈云霁
Owner ANHUI CAMBRICON INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products