Multi-modal dialogue generation model training method and device and electronic equipment
A generative model and multi-modal technology, applied in the computer field, can solve the problem of low accuracy of answering signals and achieve the effect of strong text dialogue ability
Active Publication Date: 2022-04-29
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Because in the related art, the answer sentence is determined only according to the single feature of the text contained in the input speech signal, which may lead to a lower accuracy of the final answer signal
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0042] Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
[0043] Embodiments of the present disclosure relate to artificial intelligence technology fields such as computer vision and deep learning.
[0044] Artificial Intelligence (Artificial Intelligence), the English abbreviation is AI. It is a new technical science that studies and develops theories, methods, technologies and application systems for simulating, extending a...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention provides a multi-modal dialogue generation model training method and device and electronic equipment, and relates to the technical field of computers, in particular to the technical field of artificial intelligence such as natural language processing, deep learning and computer vision. Comprising the steps that a first training data set is acquired, and the first training data set comprises a first dialogue corpus pair; pre-training the initial dialogue generation model based on the first training data set to generate a reference dialogue generation model; a second training data set is obtained, and the second training data set comprises a second dialogue corpus pair and a corresponding face image; and based on the second training data set and a first preset adjustment weight, performing correction training on the reference dialogue generation model and the image feature extraction network to obtain a multi-modal dialogue generation model. Therefore, the generated multi-modal dialogue generation model not only has strong text dialogue ability, but also can accurately predict the reply signal corresponding to the voice input signal.
Description
technical field [0001] The present disclosure relates to the field of computer technology, in particular to the field of artificial intelligence technology such as natural language processing, deep learning, and computer vision, and in particular to a training method, device, and electronic equipment for a multimodal dialogue generation model. Background technique [0002] With the continuous development and improvement of artificial intelligence technology, it has played an extremely important role in various fields related to human daily life. For example, artificial intelligence has made remarkable progress in the field of spoken dialogue. In related technologies, the input speech signal can be converted into text, and semantic analysis is performed on the text to determine the reply sentence, and then the reply signal is synthesized. In the related art, the answer sentence is determined only according to the single feature of the text contained in the input voice signal...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F16/332G06V40/16G06V20/40G06V10/82G06N3/04G06N3/08G10L15/06G10L15/16G10L15/22G10L15/24
CPCG06F16/3329G06N3/08G10L15/22G10L15/063G10L15/24G10L15/16G10L2015/225G06N3/044G06N3/045
Inventor 吴文权郭振
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD