Method for identifying discourse components based on graph neural network

A neural network and discourse technology, applied in the field of discourse component recognition based on graph neural network, can solve the problems of decreased text component recognition effect, increased training time, and reduced recognition effect of text component recognition system, and achieves faster speed. The speed of training, the effect of reducing the number of connected edges, and improving the effect

Active Publication Date: 2022-08-09
NAT UNIV OF DEFENSE TECH
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Taking each sentence in an article as a node, if a fully connected graph is constructed (in a graph, there is a path connecting any two vertices), then the time-consuming training of the discourse component recognition system with GNN added will be It is greatly increased, and there is a problem that after deepening the number of GNN layers, the recognition effect of discourse components decreases, because no matter what the initial state of the feature matrix is ​​(randomly generated), after multiple convolutions, the features of all nodes in the same connected component will tend to are consistent, resulting in a decline in the recognition effect of the discourse component recognition system that adds GNN
Another difficulty is how to choose a graph neural network. The graph neural network is divided into four categories, namely: graph convolutional network (GCN), graph attention network (GAT), graph generation network (GGN) and graph spatiotemporal network ( GSN), different graph neural networks will also bring different training time and effects, and need to measure different parameter selections

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for identifying discourse components based on graph neural network
  • Method for identifying discourse components based on graph neural network
  • Method for identifying discourse components based on graph neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0103] like figure 2 As shown, the present invention comprises the following steps:

[0104] Step 1: Build a text component recognition system. The system such as figure 1 As shown, it consists of a feature extraction module, a position encoding module, a discourse self-attention module, and a feature splicing module.

[0105] The feature extraction module is connected with the position encoding module and the discourse self-attention module, and its function is to extract sentence features. It is a deep feedforward neural network, which consists of a representation layer, a sequence encoding layer and a graph neural network layer. The feature extraction module summarizes the word feature information in the input article, obtains the feature representation of each sentence, uses the graph neural network to update the feature information of each sentence, obtains the feature representation of each sentence, and combines the features of each sentence. The representation is ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a discourse component identification method based on a graph neural network. The objective of the invention is to improve the accuracy of discourse component identification and a Macro-F1 value. According to the technical scheme, firstly, a discourse component recognition system combined with a graph neural network is constructed; preparing a Chinese argument data set required for training the discourse component recognition system; and training the discourse component recognition system by adopting a multi-round circulation mode to obtain an optimal network structure weight parameter, and loading the weight parameter obtained by training to the discourse component recognition system to obtain a trained discourse component recognition system. And the trained discourse component recognition system preprocesses an article input by a user and performs discourse component recognition to obtain a recognition result of the article. According to the method, the purpose of improving the discourse component recognition effect by using the graph neural network technology is achieved, and compared with an existing discourse component recognition method, the Acc value and the Macro-F1 value are both improved.

Description

technical field [0001] The present invention relates to the field of text component recognition, in particular to a text component recognition method based on a graph neural network. Background technique [0002] Natural language processing, referred to as NLP (Natural Language Processing), can be divided into two parts for understanding: "natural language" and "natural language processing". Natural language is a language that is different from computer language, which is the most essential feature that distinguishes human beings from other creatures, because among all creatures, only human beings have the ability to speak. Natural language records the information exchange in the course of human development. A simple "hello", whether in Chinese, English or other languages, or in text or voice, is a part of natural language. Natural language processing, generally speaking, is a technology that uses the natural language used by humans to communicate with machines for interact...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/33G06F40/211G06N3/04G06N3/08
CPCG06F16/3344G06F40/211G06N3/084G06N3/044G06N3/045
Inventor 黄震王思杰郭敏于修彬郭振梁苏鑫鑫陈中午罗军窦勇
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products