Rumor detection method combining self-attention mechanism and generative adversarial network

A detection method and attention technology, applied in the field of text recognition, can solve problems such as the unsatisfactory effect of extracting text semantics and key features, reduce the model's ability to extract key features, and the sequence model cannot solve the problem of feature extraction, so as to avoid rumor samples. The effect of large demand, reduction of time complexity, and enhancement of semantic feature recognition ability

Active Publication Date: 2020-12-11
CHINA THREE GORGES UNIV
View PDF8 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Rumor detection algorithms based on traditional machine learning need to pre-define and extract text-related features, and are highly dependent on specific types of data sets. Therefore, such algorithms have poor generalization ability
Use neural network structures such as LSTM, GRU, and CNN to extract rumor features to avoid artificial feature engineering. However, this type of model does not combine the characteristics of rumors spreading in the network. In terms of extracting semantic features, the model cannot distinguish key features. Rumors in life will change part of the edge information along with the timing, increasing semantic confusion, thereby reducing the ability of the model to extract key features, resulting in unsatisfactory detection results
[0004] To sum up, the traditional rumor detection algorithm has the problem of unsatisfactory extraction of text semantics and key features, while the general sequence model cannot solve the feature extraction under specific semantics in text detection, resulting in poor generalization ability of the model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Rumor detection method combining self-attention mechanism and generative adversarial network
  • Rumor detection method combining self-attention mechanism and generative adversarial network
  • Rumor detection method combining self-attention mechanism and generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] use figure 1 The rumor detection model shown, the rumor detection method combining the self-attention mechanism and the generation confrontation network, includes the following steps in sequence:

[0026] Step 1: Collect rumor text data to form a rumor data set; preprocess the text data, filter the text data with special symbols, and quantize words;

[0027] Step 2: Build a generative adversarial network generator including a self-attention layer, encode and decode the original text, such as figure 2 As shown, the feature distribution is biased towards the opposite category as much as possible, and the difference between the original sequence and the fake sequence is increased as much as possible, so as to strengthen the rumor detection ability of the discriminator model;

[0028] Step 3: Build a GAN discriminator, such as image 3 As shown, the rumor detection is performed on the original text and the text sequence decoded by the generator, and the same label text i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a rumor detection method combining a self-attention mechanism and a generative adversarial network. The rumor detection method comprises the steps of collecting rumor text datato form a rumor data set; based on a self-attention mechanism, constructing a generative adversarial network generator comprising a self-attention layer; constructing a discriminator network, and respectively carrying out rumor detection and classification on the original rumor text and the text decoded by the generator; training the generative adversarial network, and adjusting model parametersof a generator and model parameters of a discriminator; and extracting a discriminator network of the generative adversarial network, and performing rumor detection on the to-be-detected text. Compared with an existing rumor detection method, the rumor detection method is higher in detection precision and better in robustness; a self-attention layer is adopted in the generator, key features are constructed through semantic learning of rumor samples, text examples rich in expression features are generated to simulate information loss and confusion in the rumor propagation process, and the semantic feature recognition capacity of the discriminator is enhanced through adversarial training.

Description

technical field [0001] The invention belongs to the field of text recognition, and in particular relates to a rumor detection method combining a self-attention mechanism and a generated confrontation network. Background technique [0002] Rumors have timing and feature diversity, and information will be continuously processed during the dissemination process, which is very confusing. [0003] Rumor detection algorithms based on traditional machine learning need to pre-define and extract text-related features, and are highly dependent on specific types of data sets. Therefore, such algorithms have poor generalization ability. Use neural network structures such as LSTM, GRU, and CNN to extract rumor features to avoid artificial feature engineering. However, this type of model does not combine the characteristics of rumors spreading in the network. In terms of extracting semantic features, the model cannot distinguish key features. Rumors in life will change part of the edge i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/9535G06F40/30G06K9/62G06N3/04G06N3/08
CPCG06F16/9535G06F40/30G06N3/049G06N3/084G06N3/045G06F18/2415Y02A90/10
Inventor 但志平李奥刘龙文冯阳
Owner CHINA THREE GORGES UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products