Robot-oriented multimodal emotional data interaction method and device

A multi-modal, intelligent robot technology, applied in the field of intelligent robots, can solve problems such as lack of emotion and affect the effect of human-machine dialogue experience, and achieve the effect of improving the degree of intelligence and improving the ability to express emotions

Active Publication Date: 2020-04-21
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, most of the text-to-speech TTS technologies currently on the market are very flat in terms of sound effects and emotional expressions, without emotion at all, which greatly affects the experience of man-machine dialogue

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robot-oriented multimodal emotional data interaction method and device
  • Robot-oriented multimodal emotional data interaction method and device
  • Robot-oriented multimodal emotional data interaction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0037] like figure 1 As shown in FIG. 2 , a flow chart of a multi-modal emotion interaction output method for intelligent robots according to the principle of the present invention is shown.

[0038] The method starts at step S101, performing system initialization and preparing to receive multimodal input information from users. Next, in step S102, the robot receives and analyzes multi-modal interaction input information to obtain user input intention parameters and user emotion parameters. Wherein, the user's multimodal input information includes, for example, information expressed by voice, sentences input by text, information expressed by expressions or specific actions, and the like. After the robot obtains the above information through va...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an intelligent robot oriented multimodal emotion data interaction method. The method comprises a step of receiving and analyzing multimodal interactive input information so as to obtain an intention parameter and a user emotional parameter inputted by a user, a step of generating text reply information corresponding to the multimodal interactive input information with the combination with the intention parameter and the emotional parameter and generating a speech emotional parameter with the combination of the text reply information, context interaction data and the user emotional parameter, and a step of carrying out synthesis to obtain speech information according to the text reply information and the speech emotional parameter and outputting the speech information. Through the intelligent robot oriented multimodal emotion data interaction method of the embodiment of the invention, when an intelligent robot interacts with the user, the sound effects of outputted TTS speech are different in different emotional states, the emotional expression ability of the robot is improved greatly, and thus the intelligent degree of the robot is improved greatly.

Description

technical field [0001] The invention relates to the field of intelligent robots, in particular to a robot-oriented multimodal emotion data interaction method and device. Background technique [0002] Human beings not only have the ability of rational thinking and logical reasoning, but also a group with strong emotional factors. The essence of the human-computer interaction mode in the past is more about program manipulation reflecting rational thinking. Now with the development of information technology, the biggest dilemma facing human-computer interaction is how to make computers not only have IQ, but also have "emotion" to interact with humans. [0003] The development direction of artificial intelligence in the future is the emotional interaction between robots and humans, emphasizing emotional computing. While intelligent robots meet human needs, they should also allow users to have an emotional trust and dependence on them. [0004] However, most of the text-to-spe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G05B19/042G06F40/30G10L13/08
CPCG05B19/0423G05B2219/25257G06F40/30G10L13/08
Inventor 韦克礼
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap