Reading understanding method and system based on collaborative attention and self-adaptive adjustment

An adaptive adjustment and reading comprehension technology, applied in the field of reading comprehension methods and systems based on collaborative attention and adaptive adjustment, can solve problems affecting model performance and achieve high performance

Active Publication Date: 2020-03-27
CIVIL AVIATION UNIV OF CHINA
View PDF4 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the problem of information loss caused by the aggregation of long text sequences

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Reading understanding method and system based on collaborative attention and self-adaptive adjustment
  • Reading understanding method and system based on collaborative attention and self-adaptive adjustment
  • Reading understanding method and system based on collaborative attention and self-adaptive adjustment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0085] In order to verify the performance of this model, the inventors have designed corresponding embodiments, which are combined with the end-to-end neural network (Match-LSTM) based on matching long-short-term memory network and answer pointer, and the reading comprehension model (R-LSTM) based on self-matching network. Net), dynamic coordination network (DCN), bidirectional attention flow neural network model (BiDAF), simple and effective multi-paragraph reading comprehension model (S-Norm) were compared; the experiment was considered from two perspectives of learning rate and random deactivation, The influence of different parameters on the accuracy of the model was verified.

[0086] Comparison 1: In order to verify the effectiveness of the CARC model proposed in this paper in the field of machine reading comprehension, a comparative experiment was designed to evaluate the performance of the coordinated attention and adaptively adjusted reading comprehension models. Expe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a reading understanding method and system based on collaborative attention and self-adaptive adjustment, which belong to the technical field of machine reading understanding. The method is characterized by comprising the following steps: S1, inputting a document word vector and a problem word vector, and training the document word vector and the problem word vector, the word vector comprising two granularities of character-level embedding and word embedding; s2, calculating a similarity weight of the problem and the document by using cosine similarity, and performing adaptive adjustment on document word embedding according to the similarity weight; s3, encoding the document word vector and the problem word vector through a multi-layer bidirectional gating loop unit;s4, using a collaborative attention mechanism for the document and the question, and obtaining a document vector representation query-aware with question perception and a question vector representation para-aware with document perception; s5, learning an internal dependency relationship between the document and the question by using a self-attention mechanism, and obtaining a new semantic vectorrepresentation; s6, using the attention as a pointer, predicting the starting position and the ending position of the answer, and extracting an answer sequence according to the answer span.

Description

technical field [0001] The invention belongs to the technical field of machine reading comprehension, and in particular relates to a reading comprehension method and system based on cooperative attention and self-adaptive adjustment. Background technique [0002] In natural language processing and artificial intelligence research, machine reading comprehension focuses on the ability to understand and reason about natural language, which is a challenging task. Machine reading comprehension means that documents and questions are given in the form of natural language, and the machine returns the correct answer through understanding and reasoning of natural language. According to the type of question, reading comprehension tasks can be divided into three categories: answer-choice type, cloze type and question-answer type. The answer selection type aims to select the option closest to the semantics of the document as the correct answer from multiple candidate answers based on th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F40/289G06F40/30G06N3/04G06N3/08
CPCG06N3/08G06N3/044G06N3/045Y02D10/00
Inventor 王怀超李宏伟曹卫东
Owner CIVIL AVIATION UNIV OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap