Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image classification network compression method based on convolution kernel shape automatic learning

A technology for automatic learning and classification of networks, applied in neural learning methods, biological neural network models, instruments, etc., can solve the problem of inability to remove redundant parameters of convolution kernels, achieve good network compression effect, improve performance, and reduce the amount of calculation. Effect

Pending Publication Date: 2021-07-02
NORTHWESTERN POLYTECHNICAL UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method belongs to the structured pruning method, and the convolution channel is used as the smallest unit for pruning, but the redundant parameters inside the convolution kernel cannot be removed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image classification network compression method based on convolution kernel shape automatic learning
  • Image classification network compression method based on convolution kernel shape automatic learning
  • Image classification network compression method based on convolution kernel shape automatic learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Now in conjunction with embodiment, accompanying drawing, the present invention will be further described:

[0029] The present invention proposes an image classification network compression method based on automatic learning of the shape of the convolution kernel. The automatic learning process of the shape of the convolution kernel is as follows: image 3 shown. The specific embodiment of the present invention is described below in conjunction with image classification example, but technical content of the present invention is not limited to described scope, and specific embodiment comprises the following steps:

[0030] (1) Build a convolutional neural network for image classification, and build an image dataset with a large number of training samples and labels.

[0031] (2) For the convolution layer in the neural network, the convolution calculation process of the conventional convolution kernel is:

[0032] Y=X*w

[0033] In the formula, is the input feature ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an image classification network compression method based on convolution kernel shape automatic learning, and belongs to the technical field of image processing and recognition. According to the invention, multiple sparse regular constraints are applied to parameters of all positions in a conventional convolution kernel, internal parameters of the convolution kernel are sparse in the network training process, a clipping threshold value is set according to a compression ratio, and then an automatically learned convolution kernel shape can be obtained, so that internal redundant parameters of the convolution kernel can be effectively eliminated. When the invention is applied to an image classification task, the classification accuracy can be ensured, the compression ratio of a network model can be further improved, the parameter quantity and the calculation quantity of the model are reduced, and deployment and application in mobile equipment with limited resources are facilitated.

Description

technical field [0001] The invention belongs to the technical field of image processing and recognition, in particular to an image classification network compression method based on automatic learning of convolution kernel shape. Background technique [0002] Image classification and recognition is an important topic in the field of machine vision. Early image recognition methods mainly relied on manually extracted features, which had low accuracy and limited applicability to different scenarios. With the emergence of deep learning methods, convolutional neural networks have made great achievements in the field of machine vision such as image recognition and target detection. Deep neural networks can effectively extract advanced semantic features in images, and have been able to achieve recognition beyond human ability. [0003] However, while the network performance is improving, the network structure is becoming more and more complex, and the requirements for the storage ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08G06K9/62
CPCG06N3/082G06N3/045G06F18/24
Inventor 张科刘广哲
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products