Machine reading comprehension model training method, device, electronic device and storage medium
A technology for reading comprehension and model training, applied in natural language processing and computer fields, can solve problems such as increasing the difficulty of reading comprehension models and the complexity of training, and achieve the effects of low cost, improved robustness, and improved anti-noise ability
Active Publication Date: 2021-04-06
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF10 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] This application proposes a machine reading comprehension model training method, device, electronic equipment, and storage medium, which are used to solve related technologies. By adding more data from other sources to the model input, the way to improve the anti-noise ability of the model will be The problem of increasing the difficulty and training complexity of the reading comprehension model
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0034] Exemplary embodiments of the present application are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present application to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
[0035] The following describes the machine reading comprehension model training method, device, electronic device, and storage medium of the embodiments of the present application with reference to the accompanying drawings.
[0036] In the embodiment of this application, in view of the technical problem that in the related art, adding more data from other sources to...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The application discloses a machine reading comprehension model training method, device, electronic equipment and storage medium, and relates to the field of NLP. The specific implementation scheme is: based on the acquired sample data, train the initial model to generate an intermediate model; extract samples to be processed from the sample data according to a first preset rule; generate noise text according to a preset noise generation method; The noise text is added to each sample to be processed to obtain the noise sample; based on the noise sample, the intermediate model is modified and trained to generate a machine reading comprehension model. This method trains the model by automatically generating noise text during the training process of the machine reading comprehension model, so as to improve the anti-noise ability of the machine reading comprehension model, improve the robustness of the model, and does not need to modify the model, and does not require manual participation, and the cost is low .
Description
technical field [0001] The present application relates to the technical field of computers, in particular to the technical field of Natural Language Processing (NLP), and in particular to a machine reading comprehension model training method, device, electronic equipment and storage medium. Background technique [0002] Without any noise, the machine reading comprehension model can correctly find the answer to the question in a given passage. At present, in order to improve the robustness of the machine reading comprehension model, the ability of the machine reading comprehension model to resist noise is usually enhanced by adding more data from other sources to the model input, such as adding a strong language model as input. [0003] However, in this way, the reading comprehension model needs to be modified, which increases the difficulty of the reading comprehension model and the complexity of training. Contents of the invention [0004] This application proposes a mac...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06N20/00G06N3/08
CPCG06N20/00G06N3/084G06F40/30G06F40/242G06F17/16
Inventor 刘凯佘俏俏
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD