Neural network model pruning method and device, computer equipment and storage medium

A neural network model and pruning technology, applied in the field of artificial intelligence, can solve problems such as tediousness, reducing the size of neural network models, and shortening inference time.

Pending Publication Date: 2021-01-12
PING AN TECH (SHENZHEN) CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Pruning refers to deleting some connections and weight parameters in the neural network, thereby reducing the size of the neural network model, while shortening the inference time to a certain extent, but without significantly reducing the performance of the neural network
However, the traditional neural network model pruning method is cumbersome and difficult to control effectively.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network model pruning method and device, computer equipment and storage medium
  • Neural network model pruning method and device, computer equipment and storage medium
  • Neural network model pruning method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0052] The neural network model pruning method provided by this application can be applied to such as figure 1 shown in the application environment. Wherein, the client 102 communicates with the server 104 through the network. The client 102 sends the data to be processed to the server 104, and the server 104 obtains the data to be processed, inputs the data to be processed into the initial neural network model, and respectively obtains the feature map output by each layer of the initial neural network model; Decompose the feature map to obtain the redundancy data and ch...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of artificial intelligence, and provides a neural network model pruning method and device, computer equipment and a storage medium. The method comprises the steps ofobtaining to-be-processed data, inputting the to-be-processed data into an initial neural network model, and respectively obtaining a feature map output by each layer of the initial neural network model; decomposing the feature map output by each layer to obtain redundancy data and channel index data corresponding to the feature map; determining pruning channel data of each layer based on the redundancy data and the channel index data; and carrying out pruning processing on the initial neural network model based on the pruning channel data. By processing the feature map, redundancy data and channel index data are obtained at the same time, a basis is provided for determining pruned channel data, other constraints do not need to be added, pruning operation can be effectively carried out, operation is easy, and control is convenient.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence, in particular to a neural network model pruning method, device, computer equipment and storage medium. Background technique [0002] With the development and progress of computer technology, deep learning has developed rapidly in various fields. Among them, neural network models have been widely used in many tasks such as image classification, object detection, semantic segmentation, and instance segmentation. With the continuous development of applications, the amount of parameters and calculations of neural network models are also increasing, which limits the application of neural network models to devices with limited computing resources such as mobile terminals. [0003] Therefore, how to obtain a smaller neural network model is of great significance for application scenarios with limited computing resources. Pruning refers to deleting some connections and weight pa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/08
CPCG06N3/082
Inventor 潘浩钱江庄伯金王少军
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products