Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Unreal information detection method based on BERT model and enhanced hybrid neural network

A hybrid neural network and information detection technology, applied in the field of false information detection based on the BERT model and enhanced hybrid neural network, can solve problems such as difficulty in ensuring detection accuracy, ignoring the distinction between expressions, cumbersome engineering, etc., to avoid the problem of gradient disappearance , reduce unreasonable influence, and improve the effect of bidirectional semantic features

Pending Publication Date: 2020-12-11
CHINA THREE GORGES UNIV
View PDF0 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In recent years, platforms for exposing false information on the Internet mostly rely on experts in various fields to identify false information, which consumes a lot of manpower and time. It is difficult to guarantee the accuracy of detection and the detection time is long. Therefore, it is very realistic to build an automatic false information detection system. significance
[0003] The feature engineering of the false information detection algorithm based on traditional machine learning is cumbersome, so most researchers focus on the deep learning-based false information detection algorithm, but the existing deep learning-based false information detection algorithm ignores the false information text Differential expressions of polysemous words, and most of them use a single deep neural network, which cannot aggregate the advantages of different types of deep neural networks, resulting in unsatisfactory detection results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unreal information detection method based on BERT model and enhanced hybrid neural network
  • Unreal information detection method based on BERT model and enhanced hybrid neural network
  • Unreal information detection method based on BERT model and enhanced hybrid neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The false information detection method based on the BERT model and the enhanced hybrid neural network uses the false information detection model of the enhanced hybrid neural network to detect false information. The false information detection model includes a sequentially connected CNN network, BiLSTM network, and attention layer. and an output layer such as Figure 1-5 As shown, the false information detection method includes the following steps,

[0026] Step 1: After preprocessing the text data, use the BERT model for processing, such as figure 2 shown;

[0027] Step 2: CNN network such as image 3 As shown, three different sizes of convolution kernels are used to perform convolution pooling operations on the input matrix, and the text features are horizontally stitched into a feature sequence.

[0028] Step 3: BiLSTM layers such as Figure 4 As shown in Fig. 1, the feature sequence is input to the BiLSTM layer, and the deeper semantic features of tweets are fu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an unreal information detection method based on a BERT model and an enhanced hybrid neural network. The method comprises the steps of preprocessing a to-be-detected text; performing convolution and pooling operation on the input matrix by using a CNN network, and splicing the input matrix into a feature sequence; taking the feature sequence as the input of a BiLSTM network,and comprehensively capturing the deep semantic features of the text from the front direction and the rear direction by using a forward LSTM unit and a backward LSTM unit respectively; generating a semantic code containing attention distribution by utilizing an attention layer, and optimizing a feature vector; and finishing classification detection of the feature vectors by utilizing a classifierof the output layer, and judging whether the feature vectors are the non-real information. According to the method, the CNN, the BiLSTM and the attention mechanism are combined, the detection precision of the unreal information is high, local phrase features and global context features of the text of the unreal information can be extracted, text keywords can also be extracted, and the unreasonable influence of irrelevant information on a detection result is reduced.

Description

technical field [0001] The invention belongs to the field of text detection and recognition, and in particular relates to a false information detection method based on a BERT model and an enhanced mixed neural network. Background technique [0002] With the rapid development of Internet technology, false information on the Internet is rampant, and the dissemination of false information on the Internet affects the normal social order and disrupts social order. It is very important to effectively and quickly detect false information on the Internet and suppress its spread. In recent years, platforms for exposing false information on the Internet mostly rely on experts in various fields to identify false information, which consumes a lot of manpower and time. It is difficult to guarantee the accuracy of detection and the detection time is long. Therefore, it is very realistic to build an automatic false information detection system. significance. [0003] The feature engineeri...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/30G06F40/284G06F40/211G06N3/04G06N3/08G06K9/62
CPCG06F40/30G06F40/284G06F40/211G06N3/049G06N3/08G06N3/045G06F18/2415
Inventor 但志平梁兆君张骁
Owner CHINA THREE GORGES UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products