Retrieval Reply Dialogue Method and System Combining Keywords and Semantic Understanding Representation

A technology for semantic understanding and keywords, applied in the field of retrieval-based reply dialogue methods and systems, can solve problems such as failure to capture key information, failure to achieve response effects, failure to filter out information, etc., to improve fluency and naturalness, The effect of eliminating errors and improving the quality of dialogue

CN113934835BActive Publication Date: 2022-03-25ZHEJIANG LAB
3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Publication Date
2022-03-25

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a search-type reply dialogue method and system combining keywords and semantic understanding representations. The system combines vector representations of two levels of granularity, which are respectively bag-of-words vector representations and semantic understanding representations. Keyword information and context-based semantic understanding are also considered, which greatly improves the performance of the retrieval reply model. In the present invention, the Chinese pre-training model Bert network model is adopted to obtain the sentence vector representation, which not only understands the sentence meaning, but also eliminates the error caused by the word vector weighting. The system uses the Bert network model to train the classification task on its own single-round dialogue—the task of whether the dialogue matches or not. Through fine-tuning, it learns the weight of the linear layer and activation function in Bert. The system uses the fine-ranking model LGMRanker, which can directly predict the relative order of replies related to the query and return a sorted list.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the field of artificial intelligence retrieval reply dialogue, in particular to a retrieval reply dialogue method and system combining keywords and semantic understanding representations. Background technique

[0002] At present, the dialogue system has attracted more and more attention in various fields. It is mainly a system that allows machines to understand and process human language through dialogue. Dialogue processes that can be modeled. Dialogue modeling is not a simple task, it is a comprehensive entity involving technologies in multiple directions such as understanding, generation, and interaction. The complexity of its dialogue scenarios, such as customer service, voice assistants, chatting, etc., also creates the complexity of the dialogue system.

[0003] Retrieval dialogue is a classic solution that abstracts a dialogue problem into a search problem. Early dialogue systems were implemented using this solution. U...

Examples

Embodiment Construction

[0083] Specific embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.

[0084] Such as figure 1 As shown, a search-based reply dialogue method that combines keywords and semantic understanding representations includes the following steps:

[0085] S1. According to the dialogue text corpus, obtain the single-sentence dialogue text and the word segmentation information of the single-sentence dialogue;

[0086] Collect Chinese dialogue text corpus[ ], respectively disassembled to obtain all single-sentence dialogue texts [[ ]] and word segmentation information, train the word2vec model, and save the word2vec model;

[0087] Preprocess the dialogue text, and respectively predict the dialogue [ ] is processed into a single-round...