Relation extraction method for automatic knowledge graph construction system

An automatic construction, knowledge graph technology, applied in neural learning methods, neural architecture, natural language data processing and other directions, can solve the problems of artificial noise, destroying the dependency structure, unable to fully utilize the dependency matrix to enrich the information, etc., to improve performance, reduce time cost effect

Pending Publication Date: 2022-01-07
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current main work is focused on how to prune the dependency tree more effectively and cut off information irrelevant to relation extraction to improve the performance of the model. However, rule-based pruning also has artificial noise, while soft pruning based on attention mechanism Branches destroy the original dependency structure and cannot make full use of the rich information contained in the dependency matrix.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Relation extraction method for automatic knowledge graph construction system
  • Relation extraction method for automatic knowledge graph construction system
  • Relation extraction method for automatic knowledge graph construction system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] see figure 1 , this embodiment provides a relation extraction method oriented to the automatic knowledge map construction system of the present invention, using a multi-head attention mechanism and a weighted dependency matrix to obtain key information of different dimensions of the text in parallel, and the specific steps are as follows:

[0054] Step 1: Perform initial word embedding on the pre-trained word vector dictionary of each word in the original text, and obtain the vector representation w of each word i , where i is the i-th word in the text. In addition, the part-of-speech tagging information and named entity recognition information of each word are also converted into vector representations, and the vector and Concatenate with the vector representation of the word itself, and finally get as the final word embedding vector representation for each word.

[0055] Step 2: The vector representation x for each word obtained in step 1 i Carry out two-way l...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a relation extraction method for an automatic knowledge graph construction system ; the method comprises the steps: coding and converting a text into word vectors, and preliminarily extracting text features; generating a syntactic dependency tree by using a syntactic dependency structure of the text, weighting each relation category to generate a weighted dependency adjacency matrix, and extracting syntactic dependency information in the text by using a graph convolutional neural network; synchronously, directly acting a multi-head attention mechanism on the encoded text to generate an attention matrix, and extracting information except syntactic dependency information of the text by using a graph convolutional neural network with the same structure; and finally, obtaining feature representations of the two entities and sentences, scoring all possible relation categories by using a feedforward neural network and a normalized exponential function, and selecting a relation with the highest score as a relation classification result. According to the method, information of different dimensions of the text can be fully acquired, and an excellent effect is achieved on a public data set for relation extraction.

Description

technical field [0001] The invention belongs to the technical field of natural language processing and artificial intelligence, and in particular relates to a relation extraction method for a knowledge map automatic construction system. Background technique [0002] Relation extraction is a key subtask in the field of natural language processing and an important part of information extraction tasks. Relation extraction aims to extract the relationship information between entities from unstructured text. By combining with the task of named entity recognition, it can generate the three-dimensional data required for building a knowledge graph system, such as <subject, predicate (relation), object> tuple. [0003] Traditional relational extraction methods mainly use linguistic knowledge to analyze texts, use statistical and rule-based methods, and manually design extraction rules or kernel functions for text matching and relational extraction. However, due to the complex...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F40/126G06F40/242G06F40/295G06N3/04G06N3/08
CPCG06F40/126G06F40/242G06F40/295G06N3/08G06N3/047G06N3/048G06N3/044G06N3/045
Inventor 徐小龙董益豪朱曼吴晓诗胡惠娟
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products