Zero sample image classification method based on combination of variational autocoder and adversarial network

A technology of sample images and classification methods, used in computer parts, neural learning methods, biological neural network models, etc.

Active Publication Date: 2018-11-23
XI AN JIAOTONG UNIV
View PDF5 Cites 92 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] The technical problem to be solved by the present invention is to provide a zero-shot image classification method based on the combination of variational autoencoder and confrontation network, which can make up for the lack of training samples in zero-shot learning. The generated pse

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Zero sample image classification method based on combination of variational autocoder and adversarial network
  • Zero sample image classification method based on combination of variational autocoder and adversarial network
  • Zero sample image classification method based on combination of variational autocoder and adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The present invention provides a zero-sample image classification method based on the combination of variational autoencoder and confrontation network, which is guided by the sample category mapping in the training set (category mapping in this method refers to the attribute label of each category) . When training the model, the samples of known categories and the attribute labels corresponding to the samples are used as the input of the model, and the parameters of the network are backpropagated through five loss functions: reconstruction loss, generation loss, discrimination loss, divergence loss, and classification loss. After the model training is completed, the random Gaussian noise of the input sample and the attributes of the unknown category are generated to generate the corresponding pseudo samples of the unknown category, and then the pseudo samples are used to train the classifier to test on the samples of the unknown category.

[0056] see figure 1, the pre...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a zero sample image classification method based on combination of a variational autocoder and an adversarial network. Samples of a known category are input during model training; category mapping of samples of a training set serves as a condition for guidance; the network is subjected to back propagation of optimization parameters through five loss functions of reconstruction loss, generation loss, discrimination loss, divergence loss and classification loss; pseudo-samples of a corresponding unknown category are generated through guidance of category mapping of the unknown category; and a pseudo-sample training classifier is used for testing on the samples of the unknown category. The high-quality samples beneficial to image classification are generated through theguidance of the category mapping, so that the problem of lack of the training samples of the unknown category in a zero sample scene is solved; and zero sample learning is converted into supervised learning in traditional machine learning, so that the classification accuracy of traditional zero sample learning is improved, the classification accuracy is obviously improved in generalized zero sample learning, and an idea for efficiently generating the samples to improve the classification accuracy is provided for the zero sample learning.

Description

technical field [0001] The invention belongs to the technical field of zero-sample image classification, and in particular relates to a zero-sample image classification method based on a combination of a variational autoencoder and an adversarial network. Background technique [0002] With the rapid development of information technology, pattern recognition is an important part of information science and artificial intelligence, mainly used in image processing, speech recognition, data mining and other disciplines. The main purpose of studying pattern recognition is to classify samples. The current effective method is supervised learning, that is, training the model through a large amount of labeled data, and then testing it on the test set. But in reality, it is difficult to obtain a large number of labeled pictures, and sometimes the labeled pictures obtained are not the category pictures that need to be classified. Therefore, the study of zero-shot learning is of great s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06K9/66G06N3/06G06N3/08
CPCG06N3/061G06N3/084G06V30/194G06F18/241
Inventor 侯兴松高蕊
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products