Image emotion classification method based on ResNet-GCN network

An emotion classification and image technology, applied in neural learning methods, biological neural network models, instruments, etc., can solve the problems of increasing network complexity, lack of specific analysis, and reducing network generalization ability, so as to achieve comprehensive and increase the emotional characteristics of images. The effect of learning vision and reducing bias

Inactive Publication Date: 2018-08-17
SOUTH CHINA UNIV OF TECH
View PDF2 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The network blindly learns the characteristics of different factors of the image, and lacks specific analysis of the relevant factors that affect the emotional expression of the image, which not only fails to significantly improve the performance of image emotion classification, but also increases the complexity of the network and reduces the generalization ability of the network.
[0005] Existing image emotion classification methods lack targeted model design and cannot effectively express global and local image information comprehensively

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image emotion classification method based on ResNet-GCN network
  • Image emotion classification method based on ResNet-GCN network
  • Image emotion classification method based on ResNet-GCN network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0054] Such as figure 1 As shown, the image emotion classification method based on the ResNet-GCN network of this implementation includes the following steps:

[0055] (1) The structural design of the image emotion classification network, the specific network parameter settings and methods are as follows:

[0056] Such as figure 2 As shown, the image emotion classification network ResNet-GCN of the present invention consists of two parts, the front part and the back part. The previous part of the structure borrowed ResNet-50 [K.He, X. Zhang, S. Ren, et al, Deep Residual Learning for Image Recognition, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp: 770-778, 2016. ] structure and parameters. This part contains 5 convolutional layer groups, 1 fully connected layer and 1 Softmax layer.

[0057] Such as image 3 As shown, the latter part of the structure borrows GCN [Peng C, Zhang X, Yu G, et al. Large KernelMatters—Improve Semantic Segmentation by Glo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image emotion classification method based on a ResNet-GCN network. The method includes following steps: (1) designing an image emotion classification network formed by a front part structure ResNet-50 network and a rear part structure GCN network; (2) designing an image emotion classification framework including one image emotion classification network ResNet-GCN and onesupport vector classifier used for deciding fusion network characteristics; (3) performing substantial main body extraction and pyramid cutting on an original image; (4) training the image emotion classification network; (5) testing the image emotion classification framework; and (6) performing classification by employing the trained image emotion classification framework by a user image to realize image emotion classification. According to the method, an image emotion classification result is in accordance with the mankind emotion standard, human participation is avoided in a determination process, and automatic image emotion classification of a machine is realized.

Description

technical field [0001] The invention relates to the technical field of image classification, in particular to an image emotion classification method based on a ResNet-GCN network. Background technique [0002] We are susceptible to all kinds of emotions stimulated by visual content, especially images. Image emotion classification is to classify images according to the human emotions aroused by images. The image emotions commonly used in the research are pleasure, awe, satisfaction, excitement, anger, disgust, fear, and sadness. Due to the complexity of images and the subjectivity of human emotions, it is a very challenging task to automatically realize image emotion classification by computer simulation of human high-level perception to judge image emotion. [0003] Existing image sentiment classification methods have gone through two stages: traditional manual feature method and deep learning method. Compared with the traditional manual feature method, the deep learning ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/2148G06F18/2411
Inventor 王伟凝李乐敏黄杰雄
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products