Unlock instant, AI-driven research and patent intelligence for your innovation.

A joint entity-relationship extraction method and system based on attention mechanism

An entity relationship and attention technology, applied in neural learning methods, text database query, unstructured text data retrieval, etc., can solve problems such as inability to make better use of related words

Active Publication Date: 2021-04-20
INST OF INFORMATION ENG CHINESE ACAD OF SCI
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this type of method uses a neural network to predict the label sequence, it does not distinguish the importance of the words in the sentence from the currently predicted words, so that it cannot make better use of the information of related words while ignoring the irrelevant words. information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A joint entity-relationship extraction method and system based on attention mechanism
  • A joint entity-relationship extraction method and system based on attention mechanism
  • A joint entity-relationship extraction method and system based on attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the above objects, features and advantages of the present invention more obvious and understandable, the present invention will be further described in detail below through specific implementation cases and in conjunction with the accompanying drawings.

[0031] figure 1 It is a flow chart of the joint entity relationship extraction method based on the attention mechanism in this embodiment. As shown in the figure, the method mainly includes three stages, namely: the data preprocessing stage, the attention mechanism-based network model training stage, and the The predicted label sequence is matched to obtain the phase of relational entity triples.

[0032] (1) Data preprocessing stage

[0033] Step 1: According to the triplet information given in the labeled corpus, it is converted into a label sequence. Each label contains three types of information: the position of the word in the entity, the relationship type corresponding to the triplet that the e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an attention mechanism-based entity-relationship joint extraction method and system. The steps of the method include: converting the triplets of entities and relationships marked in the training data into a form in which each word corresponds to a predefined type of label; mapping each word in the sentence of the training data into a corresponding word Vector, input the neural network model based on the attention mechanism, and train through the backpropagation algorithm to obtain the label prediction model; input the sentence that needs to be extracted from the entity relationship into the trained label prediction model, and predict the label corresponding to each word , according to the corresponding relationship between the label and each word in the triplet, the entity-relationship triplet existing in the sentence is obtained. The system includes a preprocessing module, a model training module and a result processing module. The present invention improves the performance of joint extraction of relational entities through more effective use of key information in sentences, and has good practicability.

Description

technical field [0001] The present invention relates to deep learning and natural language processing technology, in particular to an attention mechanism-based entity-relationship joint extraction method and system. Background technique [0002] In recent years, with the rapid development of Internet information technology, news, social networking and other websites generate massive amounts of new data every day. These data contain a variety of contents, including a lot of very valuable information, which plays a vital role in people's lives. In order to extract and effectively use these valuable information, the concept of knowledge graph is proposed. In the knowledge graph, special nouns such as names of people and places in massive data are represented as entities, and the connection between any two entities is represented as a relationship. Such massive data is represented as a triplet of entities and relationships (entity 1, relationship, entity 2). Although the exis...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/33G06F16/36G06N3/08
Inventor 虎嵩林周艳黄龙涛韩冀中
Owner INST OF INFORMATION ENG CHINESE ACAD OF SCI