Training method and device of neural network model for sample classification

A neural network model and sample technology, applied in the field of neural network model training, can solve the problem of high complexity of neural network models, and achieve the effect of preventing overfitting and improving generalization.

Pending Publication Date: 2020-01-14
ADVANCED NEW TECH CO LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to too many parameters, the complexity of the neural network model is too high. In most cases, the neur

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training method and device of neural network model for sample classification
  • Training method and device of neural network model for sample classification
  • Training method and device of neural network model for sample classification

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The solutions provided in this specification will be described below in conjunction with the accompanying drawings.

[0037] figure 1 It is a schematic diagram of an implementation scenario of an embodiment disclosed in this specification. This implementation scenario involves the training of a neural network model for sample classification. Specifically, the neural network model may be trained based on the training samples. In the embodiment of the present specification, the training samples have sample identifiers and pre-marked sample category labels. It can be understood that the above neural network model can be applied to classify samples in various scenarios, for example, classify items, classify users, and so on. In an example, the training sample corresponds to one user, the sample identifier is an identifier of the one user, and the sample category label corresponds to a user group including multiple users. refer to figure 1 , each training sample included...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a training method and device of a neural network model for sample classification. The method comprises the steps of obtaining training samples in a training sample set, wherein the training samples have sample identifiers and sample category labels; inputting the training sample into a feature extraction model to obtain a feature representation vector; inputting the feature representation vector into a discriminator model to obtain an identification mark; determining a first prediction loss according to the identification identifier and the sample identifier, and performing first training on the discriminator model and the feature extraction model by taking minimization of the first prediction loss as a target; inputting the feature representation vector into a classifier model to obtain an identification category; and determining a second prediction loss according to the identification category and the sample category label, determining a thirdprediction loss according to the negative correlation with the first prediction loss and the positive correlation with the second prediction loss, and carrying out second training on the classifier model and the feature extraction model by taking minimization of the third prediction loss as a target. And the generalization of the model can be improved.

Description

technical field [0001] One or more embodiments of this specification relate to the computer field, and in particular to a training method and device for a neural network model for sample classification. Background technique [0002] In deep learning, a larger neural network model is usually set up to fit the training data so that the neural network model can be used for sample classification. However, due to too many parameters, the complexity of the neural network model is too high. In most cases, the neural network model will be overfitted, and the generalization of the trained neural network model will not be the best. [0003] Therefore, it is hoped that there will be an improved solution, which can prevent the neural network model from overfitting and improve the generalization of the trained neural network model during the training process of the neural network model. Contents of the invention [0004] One or more embodiments of this specification describe a trainin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/241
Inventor 马良庄
Owner ADVANCED NEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products