Text sentiment classification algorithm based on convolutional neural network and attention mechanism

A convolutional neural network and emotion classification technology, applied in biological neural network models, neural architecture, computing, etc., can solve problems such as rigidity, lack of diversity, fixed local information granularity, etc., to achieve good classification effect and increase residual connection. and nonlinear effects

Active Publication Date: 2018-10-16
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 82 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, ordinary convolutional neural networks set fixed filters and pooling operation types, ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text sentiment classification algorithm based on convolutional neural network and attention mechanism
  • Text sentiment classification algorithm based on convolutional neural network and attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The present invention will be further described below in conjunction with specific examples.

[0027] see figure 1 with figure 2 As shown, the text sentiment classification algorithm based on convolutional neural network and attention mechanism provided in this embodiment includes the following steps:

[0028] 1) Establish a convolutional neural network that includes multiple convolutions and pooling, and use sentiment classification text for training to obtain the first model; wherein, establishing a convolutional neural network that includes multiple convolutions and pooling includes the following steps :

[0029] 1.1) Establish two different types of convolutions. The convolution kernel of the first kind of convolution is the overall convolution kernel, which matches the entire word vector. The convolution kernel of the second convolution is a single-dimensional convolution kernel, which is in the word Matches are performed on each dimension of the vector. Suppo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a text sentiment classification algorithm based on a convolutional neural network and an attention mechanism. The text sentiment classification algorithm comprises the steps of1, establishing the convolutional neural network comprising multiple convolutions and multiple kinds of pooling, and using sentiment classification text for training to obtain a first model; 2, establishing the multi-head point product attention mechanism into which residual connection and nonlinearity are added, and using the sentiment classification text for training to obtain a second model; 3, conducting model fusion on the two models to obtain sentiment classification of the text. Multiple granularity, the convolutions and multiple kinds of pooling are fused into the convolutional neuralnetwork, the residual connection and the nonlinearity are introduced into the attention mechanism, and attention is calculated several times to obtain two text sentiment classification models. Through a Bagging model fusion method, a fusion model is obtained, the text is classified, the advantages that the convolutional neural network can well capture local features and the attention mechanism can well capture global information can be combined, and the more comprehensive text sentiment classification models are obtained.

Description

technical field [0001] The invention relates to the field of text classification of natural language processing, in particular to a text emotion classification algorithm based on a convolutional neural network and an attention mechanism. Background technique [0002] Text classification has various applications, such as sentiment polarity classification, topic classification, etc. For text classification, there are many commonly used methods, such as unsupervised methods based on dictionaries and rules, and supervised methods based on machine learning. The dictionary-based method uses authoritative dictionaries and artificially constructs features according to experience. The accuracy of the model is high, but the recall rate of the model is low due to the low coverage of the dictionary. Supervised methods based on machine learning, modeled using machine learning methods such as SVM, maximum entropy model, naive Bayesian, and KNN. These machine learning methods are relativ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06F17/27G06N3/04
CPCG06F40/284G06N3/045
Inventor 董敏汤雪毕盛
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap