Zero-shot Image Classification Method Based on Regression Variational Autoencoder

A technology of self-encoder and sample image, which is applied in neural learning methods, instruments, computer components, etc.

Active Publication Date: 2022-05-17
HEBEI UNIV OF TECH
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0012] When solving the generalized zero-sample image classification problem, a part of the known class data set in the database is used as a training set, and the other part and an unknown class data set are used as a test set, and the data used include known class image features v seen Data and known class semantic features c seen data, and unknown class image features v unseen Data and Unknown Class Semantic Features c unseen Data, all data are from the selected data disclosed in the document "Zero-Shot Learning-A Comprehensive Evaluation of the Good, the Bad and the Ugly", all image features are from the well-known residual network ResNet-101 of 2048 Dimensional final pooling layer, the data used is manually marked with attribute information as semantic features to complete data preprocessing;

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Zero-shot Image Classification Method Based on Regression Variational Autoencoder
  • Zero-shot Image Classification Method Based on Regression Variational Autoencoder
  • Zero-shot Image Classification Method Based on Regression Variational Autoencoder

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0074] The first step, data preprocessing:

[0075] When solving the generalized zero-sample image classification problem, a part of the known class data set in the database is used as a training set, and the other part and an unknown class data set are used as a test set, and the data used include known class image features v seen Data and known class semantic features c seen data, and unknown class image features v unseen Data and Unknown Class Semantic Features c unseen Data, this embodiment is tested on 4 data sets, namely AWA1, AWA2, CUB and SUN, all data are from the document "Zero-Shot Learning-A Comprehensive Evaluation of the Good, the Bad and the Ugly" published Available data, all image features come from the 2048-dimensional final pooling layer of the well-known residual network ResNet-101, and use manual labeling attribute information as semantic features to complete data preprocessing;

[0076] In the second step, train the aligned cross reconstruction variati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention is based on a zero-sample image classification method of a regression variational autoencoder, and relates to a method for using electronic equipment to identify graphics. By training and aligning cross-reconstructed variational autoencoders, the regression network loss is calculated, and the overall model network is calculated. Loss L, train the classifier, calculate the classification accuracy rate, and complete the zero-sample image classification based on the regression variational autoencoder, which overcomes the lack of training samples in the existing technology of generalized zero-sample classification, and the generated samples lack semantic and Generate defects against which the network is prone to collapse.

Description

technical field [0001] The technical solution of the present invention relates to a method for identifying graphics using electronic equipment, specifically a zero-sample image classification method based on a regression variational autoencoder. Background technique [0002] With the continuous development of deep learning in the field of computer vision, the demand for training data is also expanding. However, in reality, it is difficult to obtain a large amount of labeled data for supervised training, so the study of zero-shot image classification problems is particularly important. The zero-sample image classification problem is to establish the connection between known class images and unknown class images through knowledge transfer, so as to realize the requirement that the model trained with known class images can classify images of unknown classes, so as to achieve zero-sample image classification. Sample image classification purposes. For example, for bears, zebras...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06V10/764G06V10/774G06V10/77G06V10/766G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/213G06F18/2148G06F18/2415
Inventor 郭迎春毕容甲阎刚于洋师硕朱叶郝小可刘依
Owner HEBEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products