A machine reading understanding model training method and device based on a joint loss function

A technology of reading comprehension and loss function, which is applied in the field of machine reading comprehension model training based on joint loss function, can solve problems such as inconsistencies in evaluation indicators, and achieve the effect of accurate model extraction answers

Active Publication Date: 2019-04-26
安徽省泰岳祥升软件有限公司
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, the above-mentioned method of using the likelihood function to maximize the probability of the observed training samples

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A machine reading understanding model training method and device based on a joint loss function
  • A machine reading understanding model training method and device based on a joint loss function
  • A machine reading understanding model training method and device based on a joint loss function

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the present invention. Rather, they are merely examples of apparatuses and methods consistent with aspects of the invention as recited in the appended claims.

[0046] The method for training a machine reading comprehension model based on a joint loss function provided in this embodiment is mainly applied to a model whose output answer is presented in the form of a start position and an end position in a document. Take the reading comprehension model QAnet jointly launched by the Google Brain team and Carnegie Mellon University (CMU) as an example. The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a machine reading understanding model training method and device based on a joint loss function. Specifically, when machine reading understanding model training is carried out,a loss function composed of a maximum likelihood estimation function and a minimum risk training function is used as an evaluation index of a machine reading understanding model so as to guide adjustment of parameters of the machine reading understanding model. The idea of the minimum risk training function is to use the loss function to describe the difference degree between the answer output bythe model and the standard answer. The maximum likelihood estimation function, namely loss, tries to find a group of model parameters, so that the loss value of the machine reading understanding modelon the training set is minimum, and therefore, compared with the mode of singly utilizing the maximum likelihood estimation function, the model trained by the method provided by the invention can extract answers more accurately.

Description

technical field [0001] The present application relates to the technical field of natural language processing, in particular to a method and device for training a machine reading comprehension model based on a joint loss function. Background technique [0002] At present, deep learning has achieved fruitful results in the fields of image recognition and speech recognition. Machine Reading Comprehension (MRC) has become a new hotspot in the field of artificial intelligence research and application. Its main function is to read and understand a given article or Context to automatically give answers to relevant questions. [0003] With the development of machine reading comprehension technology, the task of reading comprehension is also constantly upgrading, from the early "cloze form" to "single document reading comprehension" based on Wikipedia, such as Stanford SQuAD (Stanford Question Answering Dataset, Stanford Question Answering Dataset) as the task of the dataset. And f...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/08G06F16/332
CPCG06N3/084
Inventor 李健铨刘小康陈夏飞晋耀红杨凯程陈玮张乐乐董铭慆
Owner 安徽省泰岳祥升软件有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap