Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Dynamic reasoning network system and method for multi-hop question answering

A network system and dynamic technology, applied in inference methods, biological neural network models, electrical and digital data processing, etc., can solve problems such as increasing the amount of data, obtaining enough information, and unable to fully utilize text information.

Active Publication Date: 2021-03-16
SICHUAN UNIV
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] So far, the above three models have achieved some success, but there are still some limitations; first, most existing models directly reason in all given passages without passage selection to remove interfering passages, which increases the the amount of data processed; second, after existing models encode each text into a representation vector, each text is always rarely accessed, whether it is a question or a paragraph
And the model may not be able to obtain enough information by accessing the text only once or twice, which leads to the underutilization of text information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic reasoning network system and method for multi-hop question answering
  • Dynamic reasoning network system and method for multi-hop question answering
  • Dynamic reasoning network system and method for multi-hop question answering

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] refer to figure 1 , is a schematic structural diagram of a dynamic reasoning network oriented to multi-hop question answering in the present invention. Specifically, a dynamic reasoning network oriented to multi-hop question answering includes:

[0057] Paragraph selector 1, which receives paragraphs and questions, and selects subparagraphs related to the answers to questions in the paragraphs to eliminate interfering information;

[0058] In this embodiment, the paragraph selector 1 includes a pre-trained BERT model with a sentence classification layer. The pre-trained BERT model is used to predict the similarity between questions and paragraphs. The paragraph selector 1 connects "[CLS]" + question +"[SEP]" +document +"[SEP]" as input for questions and paragraphs, and outputs a matching score between 0 and 1. Paragraph selection follows the following rules: if the paragraph contains an answer, the label is 2; if the paragraph contains at least one supporting statement...

Embodiment 2

[0074] refer to image 3 It is a flow diagram of a dynamic reasoning method for multi-hop question answering in the present invention, specifically, a dynamic reasoning method for multi-hop question answering, comprising the following steps:

[0075] S600: Receive a paragraph and a question, select at least one sub-paragraph related to the answer to the question in the paragraph; then perform step S700;

[0076] In this embodiment, after receiving the paragraphs and questions that need to be inferred, the paragraph selector 1 in Embodiment 1 will select the paragraphs in the paragraphs related to the answers to the questions as sub-paragraphs, so as to eliminate the interference information, and Coding the question with the resulting subparagraph, specifically, the question is set to , with subparagraphs set to , m and n are the lengths of the question and paragraph respectively, h is the size of the hidden state, then we use collaborative attention to strengthen the inter...

Embodiment 3

[0114] In this example, the effectiveness of the system of Example 1 and the method of Example 2 is verified. Specifically, this example is used in the HotpotQA dataset (the latest benchmark dataset for multi-hop reasoning across multiple paragraphs) Evaluate the inference network of the present invention on the TriviaQA dataset (a benchmark dataset based on information retrieval (IR)), and compare the results of other models with the same parameter data,

[0115] In this example, baseline (the model used when Yang, Zhilin, et al. proposed the hotpot qa data set in 2018), GRN (a model with an acceptable ranking but unpublished papers on the leaderboard of the Hotpot qa data set in 2019), QFE (the model proposed by Nishida, Kosuke, et al. in 2019), DFGN (the model proposed by Xiao, Yunxuan, et al. in 2019) were compared with the system of the present invention, and EM and F1 were used as measurement indicators, and EM is the exact match value and F1 is the F1 score.

[0116] T...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention provides a dynamic reasoning network and method for multi-hop question answering. The network includes: a paragraph selector, which receives paragraphs and questions, and selects sub-paragraphs related to the answer of the question in the paragraph; a coding module, which uses collaborative attention to strengthen The interaction between questions and sub-paragraphs calculates the final vector representation of sub-paragraphs and the vector representation of questions; the entity graph construction module is used to construct an entity graph; the dynamic reasoning module is used to reason about entity graphs and repeatedly read text imitation The process of human analyzing information, and constructing a question reshaping mechanism to repeatedly read the question and its relevant important parts; the answer prediction module, connected to the encoding module, and connected to the dynamic reasoning module, for receiving the final vector representation of the subparagraph, And the output gets four types of predictions. The network builds a question reshaping mechanism that reads questions repeatedly to imitate people's reading habits and improves the comprehension and reasoning abilities of multi-hop reasoning question answering models.

Description

technical field [0001] The invention belongs to the field of machine reading comprehension, and in particular relates to a dynamic reasoning network and method for multi-hop question answering. Background technique [0002] Machine reading comprehension is a task that obtains the correct answer to a given question by reasoning over a set of texts, while multi-hop reasoning question answering is a subtask of machine reading comprehension that aims to find the answer to a given question across multiple passages; Most current multi-hop reasoning question answering models usually obtain answers by visiting the question only once, so the model may not be able to obtain enough textual information. [0003] The multi-hop reasoning question answering model mainly has three research directions. The first one is based on the memory network, which uses the memory unit to combine the question with the information obtained in each round, and through continuous iterative reasoning after s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06N5/04G06N3/02G06F40/205G06F40/279
CPCG06N3/02G06N5/04G06F40/205G06F40/279
Inventor 琚生根李晓辉陈润
Owner SICHUAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products