Question generation method based on progressive multi-discriminator

Abstract

The present invention relates to the technical field of question generation, and more specifically, to a question generation method based on progressive multi-discriminators. The present invention uses a generative confrontation network, the generator is used to generate questions, and the discriminator is used to evaluate the problem. In this paper, three discriminators are designed. Among them, the true and false discriminator is used to judge whether the problem is smooth and reasonable, and the attribute discriminator further judges the problem. Whether it belongs to the category corresponding to the answer, the question and answer discriminator further judges whether the question can be answered by the corresponding answer. The present invention aims at the question-and-answer mismatch problem in the text generation task. In this paper, the encoder and decoder in the generator add answer attribute information, and a progressive multi-discriminator is designed to strengthen the constraint degree of the answer from easy to difficult. The semantic quality of the generated questions, then constrains the question type of the question, and finally constrains the direct answer of the question to strengthen the matching degree between the question and the answer.

Description

technical field [0001] The present invention relates to the technical field of question generation, and more specifically, to a question generation method based on progressive multi-discriminators. Background technique [0002] This task belongs to a text generation task, which generates a corresponding question for the article and the specified answer, so that the question can be answered with the answer in the original text. It can be used in consultation systems, counseling systems, fairy tale questions, factual question and answer data generation, etc. It can also be used as a means of data reprocessing to expand the data set for question answering tasks. The question-and-answer data set can be used for question generation during training. In actual use, named entity recognition is performed on articles to extract pairs of entities, which can be used as answers for questions. [0003] The traditional approach is to extract key entities through rules based on syntax tre...

AI Technical Summary

Problems solved by technology

[0006] In the existing research, the fluency and semantic rationality of generated questions can achieve a relatively ideal effect, but there is still a lot of room for improvement in the matching degree of answers. At present, the main method is to encode and learn the answers as answer constraints. Adding it to the output of Decoder to predict the distribution of generated words, adding answer constraints on the basis of encoder-decoder can indeed greatly improve the matching degree of answers, but this constraint is not strong enough to completely solve the problem of mismatched answers, and further constraints need to be strengthened

[0007] In the study of generative confrontation, if a binary classifier is used as the discriminator, then the discriminator will be relatively simple, relatively easy to train, and its accuracy will usually exceed that of the generator, and it is difficult to coordinate between the generator and the discriminator; if the question-answering model As a discriminator, the discriminator will be more complicated, and it is not easy to adjust the model

Images