Unlock instant, AI-driven research and patent intelligence for your innovation.

Causal relationship extraction method based on BERT semantic enhancement

A causal and semantic technology, applied in the field of causal relationship extraction, can solve problems such as the difficulty of learning semantic fuzzy features, achieve the effect of effectively managing the market and improving accuracy

Pending Publication Date: 2022-05-27
ANHUI UNIV OF SCI & TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This is a defect that is difficult to learn semantic fuzzy features in the existing causal relationship extraction. Combining BERT pre-training technology and LeakGAN against the neural network model, a semantically enhanced causal relationship extraction method is proposed.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Causal relationship extraction method based on BERT semantic enhancement
  • Causal relationship extraction method based on BERT semantic enhancement
  • Causal relationship extraction method based on BERT semantic enhancement

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The present invention is further described below:

[0023] figure 1 The flow chart of the causal relationship extraction method based on BERT semantic enhancement. First, the proper nouns in the field are learned through the causal relation candidate lexicon, and the features of proper nouns are learned in BERT pre-training, and the pre-trained word vectors are input into the Bi-LSTM network to extract text features. At the same time, in order to learn more The multi-features are multi-feature fusion; then, the features are further extracted through the adversarial neural network; finally, the serialized output is performed through the CRF to realize the extraction of causal relationships.

[0024] Among them, the main tasks of the data preprocessing of the present invention include two aspects: one is to preliminarily screen the content of the text, and the sentence components are deleted by default or the sentence format is unified; the other is to mark the filtered ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a causal relationship extraction method based on BERT semantic enhancement. The causal relationship extraction method comprises the steps of causal relationship candidate word library, BERT pre-training and causal relationship extraction. The method is an information extraction technology for rapidly extracting the causal relationship in the text, and the core task is to establish a basic model and an enhancement model under the architecture of a LeakGAN adversarial neural network model to carry out adversarial learning to obtain high-distinction-degree features, analyze the causal relationship in the comment text, and realize deep extraction under semantic enhancement. The method improves the accuracy of causal relationship extraction based on the characteristic that the antagonism learning of the adversarial neural network has more distinction degree, and can be applied to the aspects of event prediction, question and answer systems, scene generation and the like.

Description

technical field [0001] The invention relates to the field of causal relationship extraction, in particular to a causal relationship extraction method based on BERT semantic enhancement. Background technique [0002] In recent years, causality extraction techniques have had an impact on all aspects of natural language processing tasks and have been widely used. Due to the uniqueness and diversity of causal relationship patterns in different fields, the complexity of the semantic structure of review texts, and the diversity of expression methods, it is inevitable to increase the difficulty of causal relationship extraction from review texts in different fields. [0003] In event prediction, question answering system and scenario generation, causality extraction technology has high application value. At the same time, due to the large amount of redundant review text information, it is necessary to use machine learning methods to quickly extract valuable information, so causali...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F40/30G06F40/242G06F16/35G06N3/04
CPCG06F40/30G06F40/242G06F16/35G06N3/044
Inventor 朱广丽孙争艳魏苏波张顺香许鑫吴厚月
Owner ANHUI UNIV OF SCI & TECH