Fixed-point operation method and device for convolutional neural network, equipment and storage medium

A convolutional neural network and fixed-point computing technology, applied in the field of deep learning, can solve problems such as low accuracy and small application range

Inactive Publication Date: 2019-03-01
GUANGZHOU BAIGUOYUAN INFORMATION TECH CO LTD
View PDF7 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0017] However, the accuracy of this method is low, the scope of application is small, and it is only suitable for simple image classification tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fixed-point operation method and device for convolutional neural network, equipment and storage medium
  • Fixed-point operation method and device for convolutional neural network, equipment and storage medium
  • Fixed-point operation method and device for convolutional neural network, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

example 2

[0258] Example Binary Convolutional Layer

[0259] The grouped convolution layer has 2 convolution groups, B1, B2

[0260] With 8 input channels channel_1, channel_2, channel_3, channel_4, channel_5, channel_6, channel_7, channel_8

[0261] Among them, channel_1, channel_2, channel_3, channel_4 are assigned to B1

[0262] channel_5, channel_6, channel_7, w_8 are assigned to B2

[0263] Set the weights of 8 fixed-point data for the 8 input channel segments, w1, w2, w3, w4, w5, w6, w7, w8

[0264] The device divides the memory into two register groups A1, A2

[0265] When offline:

[0266] Number of bits to compress w1, w2, w3, w4, w5, w6, w7, w8

[0267] Receive the first training values ​​a1', a2', a3', a4', a5', a6', a7', a8' from channel_1, channel_2, channel_3, channel_4, channel_5, channel_6, channel_7, channel__8 respectively

[0268] In B1, estimate the output values ​​of channel_1, channel_2, channel_3, and channel_4, namely a1’*w1, a2’*w2, a3’*w3, a4’*w4

[0269...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a fixed-point operation method and device for a convolutional neural network, equipment and a storage medium, the convolutional neural network comprises a convolutional layer, the method comprises the steps of receiving an input activation value of the convolutional layer through an input channel, and the input channel has a corresponding weight; Performing fixed-point operation on the input activation value to obtain a first characteristic value; respectively writing the first characteristic value and the weight into registers of a plurality of register groups; and for the plurality of register groups, respectively carrying out multiplication and addition operation according to the first characteristic values and the weights in the registers to obtain a plurality of second characteristic values. Due to the fact that a plurality of registers are usually provided in the processor, accumulation operation can be carried out in the plurality of registers in a dispersed mode, namely grouping accumulation is carried out, the number of evenly-shared multiplication and addition operations is reduced, the overflow risk is reduced, the processing efficiency of application operation instructions is improved, the overall throughput capacity is increased, meanwhile, accuracy is kept, and the application range is guaranteed.

Description

technical field [0001] Embodiments of the present invention relate to deep learning technology, and in particular to a fixed-point computing method, device, device, and storage medium of a convolutional neural network. Background technique [0002] In recent years, deep learning has been widely used in vision and other fields. Among them, a series of algorithms centered on CNN (Convolutional Neural Network) have better results in image classification, object detection, and pixel-level segmentation. [0003] However, the convolutional neural network CNN has a large amount of calculations, and more than 90% of its calculation load is concentrated in the convolution operation. The usual implementation will convert the convolution layer into the multiplication operation of two matrices, and the matrix multiplication The core part is as follows: [0004] [0005] Among them, w is the weight, a is the input activation value, O is the output activation value, and N is the commo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/063
CPCG06N3/063
Inventor 熊祎易松松
Owner GUANGZHOU BAIGUOYUAN INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap