An entity relationship joint extraction method and system based on an attention mechanism

An entity relationship and attention technology, applied in neural learning methods, biological neural network models, unstructured text data retrieval, etc., can solve problems such as inability to make better use of related words, achieve good practicability, and improve performance Effect

Active Publication Date: 2019-06-18
INST OF INFORMATION ENG CAS
View PDF6 Cites 71 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this type of method uses a neural network to predict the label sequence, it does not distinguish the importance of the words in the sentence fr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An entity relationship joint extraction method and system based on an attention mechanism
  • An entity relationship joint extraction method and system based on an attention mechanism
  • An entity relationship joint extraction method and system based on an attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the above objects, features and advantages of the present invention more obvious and understandable, the present invention will be further described in detail below through specific implementation cases and in conjunction with the accompanying drawings.

[0031] figure 1 It is a flow chart of the joint entity relationship extraction method based on the attention mechanism in this embodiment. As shown in the figure, the method mainly includes three stages, namely: the data preprocessing stage, the attention mechanism-based network model training stage, and the The predicted label sequence is matched to obtain the phase of relational entity triples.

[0032] (1) Data preprocessing stage

[0033] Step 1: According to the triplet information given in the labeled corpus, it is converted into a label sequence. Each label contains three types of information: the position of the word in the entity, the relationship type corresponding to the triplet that the e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an entity relationship joint extraction method and system based on an attention mechanism. The method comprises the following steps of: converting an entity marked in trainingdata and a triple of a relationship into a form that each word corresponds to a predefined type of tag; Mapping each word in the sentences of the training data into a corresponding word vector, inputting the word vectors into a neural network model based on an attention mechanism, and performing training through a back propagation algorithm to obtain a label prediction model; And inputting the sentences needing to be subjected to entity relationship extraction into the trained label prediction model, predicting a label corresponding to each word, and obtaining entity relationship triples existing in the sentences according to the corresponding relationship between the labels and the words in the triples. The system comprises a preprocessing module, a model training module and a result processing module. According to the method, by more effectively utilizing the key information in the sentences, the joint extraction performance of the relational entities is improved, and the method hasgood practicability.

Description

technical field [0001] The present invention relates to deep learning and natural language processing technology, in particular to an attention mechanism-based entity-relationship joint extraction method and system. Background technique [0002] In recent years, with the rapid development of Internet information technology, news, social networking and other websites generate massive amounts of new data every day. These data contain a variety of contents, including a lot of very valuable information, which plays a vital role in people's lives. In order to extract and effectively use these valuable information, the concept of knowledge graph is proposed. In the knowledge graph, special nouns such as names of people and places in massive data are represented as entities, and the connection between any two entities is represented as a relationship. Such massive data is represented as a triplet of entities and relationships (entity 1, relationship, entity 2). Although the exis...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/33G06F16/36G06N3/08
Inventor 虎嵩林周艳黄龙涛韩冀中
Owner INST OF INFORMATION ENG CAS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap