Unlock instant, AI-driven research and patent intelligence for your innovation.

Neural network processing unit npu, neural network processing method and device thereof

A neural network and processing unit technology, applied in AI and data processing fields, can solve problems such as large resource consumption and large system scheduling loss

Active Publication Date: 2022-04-12
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this way, there are still technical problems of excessive resource consumption and excessive system scheduling loss

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network processing unit npu, neural network processing method and device thereof
  • Neural network processing unit npu, neural network processing method and device thereof
  • Neural network processing unit npu, neural network processing method and device thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0024] The following is a brief description of the technical field involved in the scheme of the present disclosure:

[0025] Data processing is the collection, storage, retrieval, processing, transformation and transmission of data. The basic purpose of data processing is to extract and deduce valuable and meaningful data for some specific people from a large amount o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The disclosure provides a neural network processing unit NPU, a neural network processing method and a device thereof, and relates to deep learning, speech technology and other fields in the field of artificial intelligence technology. The scheme is: obtain floating-point input data through the quantization unit, convert the floating-point input data into fixed-point input data, provide the fixed-point input data to the operation unit, and obtain the network parameters of the neural network and Provided to the operation unit, and perform matrix vector operation and / or convolution operation on the quantized input data through the operation unit based on the network parameters to obtain the operation result of the quantized input vector, thereby supporting floating-point and fixed-point types at the same time The combination of representation and adaptability, while ensuring the accuracy requirements, reduces power consumption and improves the computing power of the NPU.

Description

technical field [0001] Embodiments of the present disclosure generally relate to the technical field of data processing, and more specifically relate to AI (Artificial Intelligence, artificial intelligence) fields such as deep learning and speech technology. Background technique [0002] In related technologies, data processing based on neural networks often adopts the method of multiplying vectors by matrices. In this case, the NPU developed based on this can be calculated by adding more ALUs (Arithmetic and Logic Unit, Arithmetic Logic Unit) unit to achieve a substantial increase in matrix operation performance and reduce power consumption and area overhead. Among them, the ALU units in the NPU all use custom floating-point precision. In this way, there are still technical problems of excessive resource consumption and excessive system scheduling loss. Therefore, how to save chip cost, reduce resource consumption and system scheduling loss while improving NPU computing p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/16G06N3/04G06N3/063
CPCG06N3/04G06N3/063G06F17/16
Inventor 田超贾磊闻军会邓广来李强
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD