Machine reading understanding method, system and device based on external knowledge enhancement

Abstract

The invention belongs to the technical field of natural language processing, particularly relates to a machine reading understanding method, system and device based on external knowledge enhancement,and aims to solve the problem that the existing machine reading understanding method does not utilize graph structure information among triples, so that the answer prediction accuracy is relatively low. The method of the system comprises the following steps: generating context representations of entities in a question and an original text; based on an external knowledge base, obtaining a triple set of each entity in the question and original text and a triple set of adjacent entities of each entity in the original text; based on the triple set, obtaining knowledge sub-graphs of each entity through an external knowledge graph; updating the fused knowledge sub-graph through a graph attention network to obtain knowledge representation; and splicing the context representation and the knowledgerepresentation through a sentry mechanism, and obtaining answers to the to-be-answered questions through a multilayer perceptron and a softmax classifier. According to the method, the graph structureinformation among the triples is utilized, so that the answer prediction accuracy is improved.

Description

technical field [0001] The invention belongs to the technical field of natural language processing, and in particular relates to a machine reading comprehension method, system and device based on external knowledge enhancement. Background technique [0002] Machine reading comprehension is a very important research task in natural language processing. Machine reading comprehension requires the system to answer the corresponding question by reading a related article. In reading comprehension tasks, using external knowledge is a very popular research direction. How to use external knowledge in reading comprehension systems has also received extensive attention. The source of external knowledge is mainly divided into two categories, one is unstructured external natural language corpus; the other is structured knowledge representation, such as knowledge graph. The present invention mainly focuses on how to utilize structured knowledge representation. In a structured knowledg...

AI Technical Summary

Problems solved by technology

[0004] In order to solve the above-mentioned problems in the prior art, that is, in order to solve the problem that the existing machine reading comprehension method does not use the graph structure information between the triples in the external knowledge, resulting in a low accuracy rate of answer prediction, the first aspect of the present invention proposes A method of machine reading comprehension enhanced based on external knowledge is proposed, which includes:

Images