Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Fixed-point multiplication and addition operation unit and method suitable for mixed precision neural network

A neural network and addition operation technology, applied in the field of fixed-point multiplication and addition operation units, can solve the problems of redundant idle resources and large hardware overhead

Active Publication Date: 2021-06-22
SOUTH UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA
View PDF9 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to provide a fixed-point multiplication and addition operation unit and method suitable for mixed-precision neural networks in view of the above-mentioned defects of the prior art, aiming to solve the problem of using a variety of different precisions in the prior art. The unit processes mixed-precision operations, resulting in excessive hardware overhead, redundant idle resources, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fixed-point multiplication and addition operation unit and method suitable for mixed precision neural network
  • Fixed-point multiplication and addition operation unit and method suitable for mixed precision neural network
  • Fixed-point multiplication and addition operation unit and method suitable for mixed precision neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] In order to make the object, technical solution and advantages of the present invention more clear and definite, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0067] It should be noted that if there is a directional indication (such as up, down, left, right, front, back...) in the embodiment of the present invention, the directional indication is only used to explain the position in a certain posture (as shown in the accompanying drawing). If the specific posture changes, the directional indication will also change accordingly.

[0068] At present, artificial intelligence algorithms are widely used in many commercial fields. In order to improve the performance of network computing, the quantization of different layers of the network is one of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a fixed-point multiply-add operation unit and method suitable for a mixed precision neural network, and the method comprises the steps: inputting different input data precisions into a multiplier from different positions, controlling the multiplier to shield a partial product of a designated region according to a mode signal, and then outputting a partial product generation part, and carrying out summation operation on the output partial product generation part according to methods corresponding to different precisions, so as to achieve point multiplication operation of mixed precisions. According to the invention, the point multiplication operation of the mixed precision neural network can be realized by adopting one multiplier, and the problems of overlarge hardware overhead, redundant idle resources and the like caused by the need of adopting various processing units with different precisions to process the mixed precision operation in the prior art are solved.

Description

technical field [0001] The invention relates to the field of digital circuits, in particular to a fixed-point multiplication and addition operation unit and method suitable for mixed-precision neural networks. Background technique [0002] At present, artificial intelligence algorithms are widely used in many commercial fields. In order to improve the performance of network computing, the quantization of different layers of the network is one of the important methods to improve the efficiency of network computing. As the calculation carrier for algorithm implementation, artificial intelligence chips have an increasing demand for mixed-precision calculations in the process of data processing in order to meet the characteristics of network design. Conventional processors use a variety of different precision processing units to process mixed precision operations. This method causes excessive hardware overhead, redundant idle resources, and excessive delays when switching betwee...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F7/57G06N3/02
CPCG06F7/57G06N3/02Y02D10/00
Inventor 王祥龙王宇航周俊卓石港李凯毛伟安丰伟余浩
Owner SOUTH UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products