Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Zero sample image classification method based on generative adversarial network

A technology of sample images and classification methods, applied in the field of deep learning, can solve the problems of single image features, collapse of adversarial network mode, low classification accuracy, etc., to achieve diversification of visual image features, improve classification accuracy, and close correlation. Effect

Pending Publication Date: 2021-11-12
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the classification accuracy of the original zero-sample image classification method is low, and the generation confrontation network is prone to the problem of mode collapse. Only through the mutual confrontation between the generator and the discriminator will make the final generated image features tend to be single.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Zero sample image classification method based on generative adversarial network
  • Zero sample image classification method based on generative adversarial network
  • Zero sample image classification method based on generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0046] The present invention provides a zero-sample image classification method based on a generative adversarial network. By generating visual image features of unknown classes, the zero-sample classification task is transformed into a traditional image classification task. At the same time, the generator network in the generative adversarial network is Improvements are made to make the generated visual image features more realistic, thereby further improving the quality of the generated visual image features; and then the image features are used to locate the key information in the visual image features through the attention network, ignoring other interference information, so as to train The classifier enables the generator to generate visual im...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a zero sample image classification method based on a generative adversarial network, and belongs to the technical field of deep learning. The method comprises: acquiring an image data set; preprocessing the image data set to obtain a training set and a test set; constructing a core neural network, and inputting the training set into the core neural network to obtain image features and visual image features, wherein the core neural network comprises a convolutional neural network, a generative adversarial network, a reconstruction network and an attention network; calculating a loss function of the core neural network, and adjusting parameters of the core neural network; jointly training the picture image features and the visual image features to obtain a classifier; and inputting the test set into a classifier for classification. Compared with the prior art, the reconstruction network is added into the generative adversarial network, so that the visual image features generated by the generative adversarial network are more diversified; and the attention network is introduced into the generative adversarial network, so that interference information in visual image features is reduced, and the classification accuracy is improved.

Description

technical field [0001] The invention relates to a zero-sample image classification method based on a generative confrontation network, which belongs to the field of deep learning. Background technique [0002] With the development of deep learning in recent years, deep learning has also made breakthroughs in the field of natural image recognition, such as image recognition and classification, image text description, and image segmentation. The performance of object recognition and classification is particularly outstanding. However, during the development of the algorithm, shortcomings such as poor generalization ability and large training data are gradually exposed. However, the traditional method requires a large number of labels for image classification, and too large training data makes manual labeling difficult, so the traditional method cannot classify it. [0003] Larochelle et al. proposed the concept of zero-sample learning in 2008. With the great interest in zer...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06N3/04
CPCG06N3/047G06N3/045G06F18/2415G06F18/214
Inventor 刘帅黄刚戴晓峰
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products