Zero sample classification method based on antagonistic self-encoder model

An autoencoder and encoder technology, applied in the field of zero-sample classification based on the adversarial autoencoder model, can solve the problems of lack of discriminative information of visual features, ignoring the correspondence between visual features and category semantic features, etc.

Active Publication Date: 2019-03-19
TIANJIN UNIV
View PDF5 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, most adversarial networks only focus on generating distributions that approximate real visual features, but ignore the correspondence between visual features and category semantic features, making the generated visual features lack discriminative information to a certain extent.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Zero sample classification method based on antagonistic self-encoder model
  • Zero sample classification method based on antagonistic self-encoder model
  • Zero sample classification method based on antagonistic self-encoder model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] A zero-sample classification method based on an adversarial autoencoder model of the present invention will be described in detail below with reference to the embodiments and the accompanying drawings.

[0033] A zero-sample classification method based on the adversarial autoencoder model of the present invention assumes that while using the category semantic feature to generate the visual feature, the reverse process of generating the category semantic feature from the visual feature is considered. Therefore, on the basis of using the adversarial network, an autoencoder is introduced to complete the bidirectional generation process through the process of encoding and decoding, so as to achieve the purpose of generating visual features and associating visual features with category semantic features.

[0034]An autoencoder is a type of neural network that is trained to copy input to output. The autoencoder consists of two parts, namely the encoder h=E(x) and the decoder ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A zero-sample classification method based on antagonistic self-encoder model is provided. Using countermeasure self-encoder networks trained on visible classes, selecting network parameters w and v that best approximate the distribution of visual features and associate visual features with category semantic features, then the class semantic feature at of the unseen class is inputted into the network, and the Euclidean distance between the generated visual feature and the real visual feature is calculated by using the decoder network G. Finally, the category with the smallest distance is considered as the predicted category, so as to realize the task of zero-sample classification. The invention is more consistent with the characteristics of the real data, and simultaneously aligns the visual features and the category semantic features, so that better classification effect can be realized in the zero-sample task.

Description

technical field [0001] The invention relates to a zero-sample classification method. In particular, it relates to a zero-shot classification method based on an adversarial autoencoder model. Background technique [0002] Deep learning has greatly facilitated the development of computer vision, such as object classification, image retrieval, and action recognition. The performance of these tasks is usually evaluated after training with a large amount of labeled data. However, some tasks have only a small fraction of training data or even no training data, making traditional classification models perform poorly. In order to improve the classification performance of traditional classification models for classes with little or no data, zero-shot learning has attracted extensive attention. The task of Zero Shot Learning is to classify classes without training data. Humans have the ability to reason, which means that humans can successfully infer the category of unseen objects...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04
CPCG06N3/045G06F18/241
Inventor 冀中王俊月于云龙
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products