Neural network model compression method and system based on mass spectrum data set

A technology for neural network models and mass spectrometry data, applied in the field of neural network model compression methods and systems, can solve the problems of deep neural network models that are complex and not streamlined, and have high computing and storage costs

Pending Publication Date: 2021-02-05
PEKING UNIV
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] For this reason, embodiments of the present invention provide a method and system for compressing neural network models based on mass spectro

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network model compression method and system based on mass spectrum data set
  • Neural network model compression method and system based on mass spectrum data set
  • Neural network model compression method and system based on mass spectrum data set

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The implementation mode of the present invention is illustrated by specific specific examples below, and those who are familiar with this technology can easily understand other advantages and effects of the present invention from the contents disclosed in this description. Obviously, the described embodiments are a part of the present invention. , but not all examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0036] Embodiment 1 of the present invention proposes a neural network model compression method based on mass spectrum data sets, such as figure 1 As shown, the method includes:

[0037] Step S110, training the neural network model to be compressed.

[0038] In this embodiment, the basic neural network model baseline to be compressed is VGG16. The network model includes a feature extraction pa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a neural network model compression method and system based on a mass spectrum data set, and the method comprises the steps: carrying out training of a to-be-compressed neural network model, carrying out pruning of the trained neural network model, carrying out the quantification of the pruned neural network model, and combining a BN layer and a convolutional layer of the quantized neural network model to obtain a neural network model without the BN layer, and quantizing the obtained network model again to obtain a compression model. A large-scale network is used as an input model, unrelated channels are automatically identified and pruned, redundancy on parameter digits of the convolution layer and a full connection layer is removed, the BN layer is discarded, and a model which is equivalent in precision, thin and compact (efficient) is generated.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of machine learning, and in particular to a method and system for compressing neural network models based on mass spectrum data sets. Background technique [0002] Since AlexNet won the ImageNet competition in 2012, convolutional neural networks have become more and more popular in the field of computer vision. A major trend is to make deeper and more complex network models in order to improve accuracy. However, such The model is stretched in terms of scale and speed. In many real scenarios, such as robots, autonomous driving, augmented reality and other tasks, it is difficult to complete the work in real time on a platform with limited computing power. This is the limitation of the large model. Model compression refers to the use of data sets to simplify the trained deep model, and then obtain a lightweight and accurate network. The compressed network has a smaller structure and fe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/082G06N3/045
Inventor 王振宇魏剑王阳东陈严李伟
Owner PEKING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap