Dialogue reply generation method and system based on self-commenting sequence learning

Abstract

The invention discloses a dialogue reply generation method and system based on self-commenting sequence learning. The dialogue reply generation method comprises the following steps that: (1) carryingout modeling on the context language environment of a current dialogue to obtain a context semantic vector; (2) according to the context semantic vector, establishing a dialogue language based on theself-commenting sequence learning; (3) training and testing the dialogue model to independently obtain a training award value and a testing award value; (4) calculating a difference between two awardvalues, and optimizing the dialogue model through policy gradient calculation; and (5) finishing dialogue model training, and outputting the dialogue reply. By use of the method, in a training processof a dialogue generation model, the reply with a better substantive meaning can be generated towards an evaluation index optimization direction, and dialogue generation instability can be greatly lowered.

Description

technical field [0001] The invention relates to the field of natural language processing dialog systems, in particular to a method and system for generating dialog replies based on self-comment sequence learning. Background technique [0002] In recent years, dialogue systems, as an important technical support for human-computer interaction, have attracted the attention of researchers from industry and academia. Dialogue reply generation has always been one of the most popular and difficult tasks in dialogue systems. Dialogue reply generation technology, that is, given the specific context and the current chat dialogue given by the other party, the machine can generate a reply that conforms to the context and has substantive reply content through semantic understanding and semantic generation technology. This technology has been widely used in many human-computer interaction systems, such as intelligent customer service systems, chat robots, personal intelligent assistants,...

AI Technical Summary

Problems solved by technology

However, this technology still has some inherent defects: one is the generation distribution deviation, that is, the dialogue generation distribution on the training set and the test set is likely to be different

Second, the objective function does not match, and it is impossible to directly optimize the evaluation index during the training process.

However, there are still thorny problems in the dialogue reply generation algorithm based on reinforcement learning: one is based on the minimum batch gradient descent method, there are a lot of changes, if it is not well regularized, it is easy to become unstable; Under the characteristics of learning, the word space of text generation becomes extremely large, and it is difficult to get a good initialization strategy

Images