Answer selection method and apparatus based on improved attention mechanism and electronic device

A technology of attention and mechanism, applied in the field of data processing, can solve the problems that restrict the performance of machine reading comprehension system and the industrial application scope, and achieve the effect of improving the effect

Active Publication Date: 2018-12-07
北京慧闻科技(集团)有限公司
View PDF5 Cites 68 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the process of realizing the short text answer extraction based on deep learning, there are still many problems to be overcome. These problems restrict the performance of the machine reading comprehension system and the scope of practical industrial applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Answer selection method and apparatus based on improved attention mechanism and electronic device
  • Answer selection method and apparatus based on improved attention mechanism and electronic device
  • Answer selection method and apparatus based on improved attention mechanism and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] Hereinafter, exemplary embodiments according to the present application will be described in detail with reference to the accompanying drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited by the exemplary embodiments described here.

[0032] Application overview

[0033] As mentioned above, machine reading comprehension (Machine Reading Comprehension, MRC) is an important topic in the field of natural language processing. Its purpose is to allow computers to find accurate answers in massive texts, thereby reducing the cost of human beings to obtain information. Currently, the most popular machine reading comprehension task is the answer extraction task. The reading comprehension task of answer extraction refers to, given a question and a short text (usually within 1000 words) relate...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application relates to an answer selection method and apparatus based on an improved attention mechanism and electronic device. The method comprises the following steps: performing word vector conversion on the obtained text data and the problem data respectively to obtain word vector representations of each word of the problem data and the text data respectively; processing the problem data and the text data through a loop neural network model to obtain a problem semantic vector representation and a text semantic vector representation, respectively; processing the problem semanticvector representation and the text semantic vector by stacking the attention mechanism layer to obtain a contextual representation of the fusion problem information; obtaining an answer correspondingto the question data from the text data based on the context representation of the fusion question information and the question semantic vector representation. In this way, the system for machine reading comprehension is optimized through a specific model architecture incorporating an improved attention mechanism to improve the effect of short text answer extraction.

Description

technical field [0001] The present invention generally relates to the field of data processing, in particular to a method, device and electronic equipment for answer selection based on an improved attention mechanism. Background technique [0002] Since the birth of computers, computers have surpassed humans in many things. Can computers be intelligent and understand natural language like humans? Machine Reading Comprehension (MRC) is an important topic in the field of natural language processing. Its purpose is to allow computers to find accurate answers in massive texts, thereby reducing the cost of human beings to obtain information. [0003] Machine reading comprehension tasks include cloze tasks, answer extraction tasks, and more complex question-and-answer tasks based on network data. Among them, the most popular reading comprehension task is answer extraction tasks. The reading comprehension task of answer extraction refers to, given a question and a short text (usua...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/27G06N3/04
CPCG06F40/279G06F40/30G06N3/045
Inventor 杨鹏
Owner 北京慧闻科技(集团)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap