Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Zero sample learning method and system based on semantic attribute attention redistribution mechanism

A technology of semantic attribute and sample learning, applied in computer parts, instruments, biological neural network models, etc., can solve problems such as misclassification, and achieve the effect of improving stability

Active Publication Date: 2019-08-23
ZHEJIANG UNIV
View PDF3 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods essentially consider that all attributes are equally important in the classification process, while ignoring their different distributions, variances, and information entropy among different classes. This processing method is challenging in some sexual images, it is easy to cause misclassification

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Zero sample learning method and system based on semantic attribute attention redistribution mechanism
  • Zero sample learning method and system based on semantic attribute attention redistribution mechanism
  • Zero sample learning method and system based on semantic attribute attention redistribution mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0069] The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be noted that the following embodiments are intended to facilitate the understanding of the present invention, but do not limit it in any way.

[0070] Such as figure 1 As shown, the main model of the present invention is divided into a visual feature module and three branch modules respectively corresponding to three outputs of the image input, and these three branches are synchronously put into the optimization process of the whole model. Specific steps are as follows:

[0071] (a) The visual feature module learns the input image x during the zero-shot learning training process i The deep visual features θ i , the basic steps are as follows:

[0072] (a-1) Use the pre-trained large-scale neural network ResNet101 to initialize the network model parameters. input image x i First, the center is cropped to an image x' of size 224×224 ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a zero sample learning method and system based on a semantic attribute attention redistribution mechanism, and the method comprises the steps: (1) building a neural network model based on the semantic attribute attention redistribution mechanism; (2) redistributing the weight between the semantic features by using the attention of the semantic attribute space; (3) traininga neural network model by using the image data set with the label; (4) calculating the similarity between the weighted semantic features of the images and the semantic prototypes of the unknown classes, calculating the similarity between the hidden layer features and the hidden layer feature prototypes of the unknown classes, and adding the two similarities to obtain the similarity between the test image and each unknown class; and (5) sorting according to the similarity with the types, and the type with the maximum similarity is selected as the type prediction of the image. According to the method, in the training process of zero sample learning, the semantic space and the hidden layer space can be more closely linked, and a joint classification result combining the two spaces is more robust.

Description

technical field [0001] The invention relates to the field of zero-sample learning classification systems, in particular to a zero-sample learning method and system based on a semantic attribute attention redistribution mechanism. Background technique [0002] In recent years, object classification, as an important branch in the field of computer vision, has attracted the attention of researchers from industry and academia. Benefiting from the rapid development of deep learning technology, the supervised object classification task has made great progress, but at the same time, there are some limitations in the training method under this supervised condition. In supervised classification, each class needs enough labeled training samples. In addition, the learned classifier can only classify instances belonging to the classes covered by the training data, lacking the ability to handle previously unseen classes. In practical applications, there may not be enough training sampl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06N3/04
CPCG06N3/045G06F18/22G06F18/214
Inventor 刘洋蔡登
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products