Convolutional neural network processing method and device, equipment and storage medium

A convolutional neural network and processing method technology, applied in the direction of biological neural network model, physical realization, etc., can solve the problems of complex convolutional neural network model, lack of computing resources, and inability to improve the calculation speed of convolutional neural network

Active Publication Date: 2020-07-07
BIGO TECH PTE LTD
View PDF1 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Due to the requirements of information security and low latency, the calculation of the neural network needs to be migrated from the cloud to the mobile terminal. However, with the improvement of the effect of the convolutional neural network, the model of the convolutional neural network becomes more and more complex, and the amount of calculation increases sharply.
In the cloud, the convolutional neural network can be accelerated by relying on GPU (Graphics Processing Unit) parallel computing, while in the mobile terminal, due to the relative lack of computing resources, the calculation speed of the convolutional neural network cannot be improved, and thus Unable to realize real-time operation on mobile terminals

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Convolutional neural network processing method and device, equipment and storage medium
  • Convolutional neural network processing method and device, equipment and storage medium
  • Convolutional neural network processing method and device, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0041] Convolutional neural network generally consists of the following three parts, the first part is the input layer, the second part is composed of convolutional layer, activation layer and pooling layer (or downsampling layer), and the third part is composed of a fully connected multiple A layer perceptron classifier (that is, a fully connected layer) is formed. Among them, the convolutional layer is responsible for feature extraction, using two key concepts: receptive field and weight sharing; the pooling layer performs local averaging and subsampling, reducing the sensitivity of features to offset and distortion, which is due to the accuracy of features Position is secondary, and relative position to other features is more important; fully connected layers perform classification.

[0042] The convolutional layer is the core of the convolutional neural network. The convolutional layer consists of some two-dimensional neuron surfaces called feature maps. Each neuron on a f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a convolutional neural network processing method and device, equipment and a storage medium. The method comprises: obtaining an original weight matrix and an original input neuron matrix of the convolutional neural network, sequentially carrying out Winograd transformation and quantization processing on the original weight matrix to obtain a target weight matrix, sequentially carrying out quantization processing and Winograd transformation on the original input neuron matrix to obtain a target input neuron matrix, and obtaining an output neuron matrix of the convolutional neural network according to the target weight matrix and the target input neuron matrix. According to the embodiment of the invention, the time complexity of the convolutional neural network is reduced through Winograd transformation, and the data bit width of the convolutional neural network is reduced through quantization processing, so that the calculation speed of the convolutional neural network is improved.

Description

technical field [0001] Embodiments of the present invention relate to deep learning technology, and in particular to a convolutional neural network processing method, device, device, and storage medium. Background technique [0002] Since AlexNet was proposed in 2012, the convolutional neural network has achieved great success in the field of image processing. In major image competitions, the effect of the convolutional neural network far exceeds the traditional algorithm, and frequently refreshes various evaluation indicators in the industry. [0003] Due to the requirements of information security and low latency, the calculation of the neural network needs to be migrated from the cloud to the mobile terminal. However, with the improvement of the effect of the convolutional neural network, the model of the convolutional neural network becomes more and more complex, and the amount of calculation increases sharply. In the cloud, the convolutional neural network can be accele...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/063
CPCG06N3/063
Inventor 易松松熊祎
Owner BIGO TECH PTE LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products