Multi-label image classification method and system based on class activation mapping mechanism

A technology of mapping mechanism and classification method, applied in computer parts, character and pattern recognition, instruments, etc., can solve problems such as affecting the image recognition performance of graphic classification models, not considering image visual consistency, etc., to maintain visual consistency, The effect of improving the classification effect

Active Publication Date: 2021-09-28
GUANGZHOU UNIVERSITY
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Generally speaking, the existing multi-label image classification methods first use the convolutional neural network to obtain the feature vector of the image, then use the graph convolutional network (Graph Convolutional Network, GCN) to obtain the co-occurrence relation word vector between the labels, and fin

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-label image classification method and system based on class activation mapping mechanism
  • Multi-label image classification method and system based on class activation mapping mechanism
  • Multi-label image classification method and system based on class activation mapping mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0068] In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, and are not intended to limit the present application.

[0069] Aiming at the problems existing in the prior art, an embodiment of the present invention provides a multi-label image classification method based on a class activation mapping mechanism, including:

[0070] Obtain an image to be classified, and convert the image to be classified into a multidimensional tensor;

[0071] Input the multidimensional tensor into the classification model to obtain the classification result of the image to be classified;

[0072] Wherein, the classification model is obtained through the following steps of training:

[0073] Obtain a trai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-label image classification method and system based on a class activation mapping mechanism, and the method comprises the steps: obtaining a to-be-classified image, and converting the to-be-classified image into a multi-dimensional tensor; inputting the multi-dimensional tensor into a classification model to obtain a classification result of the to-be-classified image; in the model training stage, the label of each image is firstly converted into a label word vector, then the co-occurrence relationship between different labels is learned, and the relationship is fused into the label word vector, so that the problem that the dependency relationship between the labels cannot be fully learned by the existing image classification method, and the technical problem of poor image classification effect is solved. Besides, due to the fact that a class activation mapping mechanism is combined in the model training stage, the visual consistency of different styles of the same image is maintained, the classification effect of the model is improved, and the method can be widely applied to the technical field of artificial intelligence.

Description

technical field [0001] The invention relates to the technical field of artificial intelligence, in particular to a multi-label image classification method and system based on a class activation mapping mechanism. Background technique [0002] Nowadays, Multi-label image classification (Multi-label image classification) has been widely used in the field of computer vision, including multi-target recognition, sentiment analysis, medical diagnosis recognition, etc. Since each image contains multiple objects, and an image contains multiple styles, how to effectively learn the relationship between these objects and how to maintain the visual consistency between different styles of the same image is still full of challenges. challenging. [0003] Generally speaking, the existing multi-label image classification methods first use the convolutional neural network to obtain the feature vector of the image, then use the graph convolutional network (Graph Convolutional Network, GCN) t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/04
CPCG06N3/045G06F18/214G06F18/2411G06F18/254
Inventor 汪洋涛范立生彭伟龙谭伟强
Owner GUANGZHOU UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap