Multi-mode interaction method and system for multi-mode virtual robot

A technology of virtual robot and interaction method, which is applied in the field of multi-modal interaction method and system of multi-modal virtual robot, which can solve the problems that intelligent robots cannot meet the requirements, and achieve the effect of improving the viscosity and fluency of human-computer interaction

Active Publication Date: 2017-11-10
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF6 Cites 59 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in order to completely imitate human dialogue and enrich the user's inter

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-mode interaction method and system for multi-mode virtual robot
  • Multi-mode interaction method and system for multi-mode virtual robot
  • Multi-mode interaction method and system for multi-mode virtual robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0066] Figure 1-2 A schematic diagram of multimodal interaction using a virtual robot according to the present invention is shown. in, figure 1 It is a schematic diagram of the multi-modal interaction between the user and the virtual robot through the PC screen, figure 2 It is a schematic diagram of the multimodal interaction between the user and the virtual robot through holographic projection.

[0067] For clarity of expression, need to carry out following explanation before embodiment:

[0068] The virtual robot 103 is a multi-modal interactive robot, so that the multi-modal interactive robot becomes a member of the interaction process, and the user conducts questions and answers, chats, and games with the multi-modal interactive robot. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-mode interaction method for a multi-mode virtual robot. An image of the virtual robot is displayed in a preset display region of a target hardware device; and the constructed virtual robot has preset role attributes. The method comprises the following steps of obtaining a single-mode and/or multi-mode interaction instruction sent by a user; calling interfaces of a semantic comprehension capability, an emotion recognition capability, a visual capability and a cognitive capability to generate response data of all modes, wherein the response data of all the modes is related to the preset role attributes; fusing the response data of all the modes to generate multi-mode output data; and outputting multi-mode output data through the image of the virtual robot. The virtual robot is adopted for performing conversation interaction; on one hand, an individual with an image can be displayed on a man-machine interaction interface through a high-modulus 3D modeling technology; and on the other hand, the effect of natural fusion of voices and mouth shapes as well as expressions and body actions can be achieved through an animation of a virtual image.

Description

technical field [0001] The invention relates to the field of artificial intelligence, in particular to a multimodal interaction method and system for a multimodal virtual robot. Background technique [0002] With the continuous escalation of the artificial intelligence upsurge, the virtual robot chat interaction system has also attracted more and more attention from the public. The development of bot chat interaction systems strives to imitate human conversations. Early well-known chatbots, including Xiaoi chatbot, Apple's Siri chatbot, etc., process received input (including text or voice) and respond in an attempt to mimic human responses. [0003] However, in order to completely imitate human dialogue and enrich user interaction experience, these existing intelligent robots are far from meeting the requirements. Contents of the invention [0004] In order to solve the above problems, the present invention provides a multi-modal interaction method for a multi-modal vir...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/01G06F17/30G06N3/00G06T13/40
CPCG06F3/011G06F2203/011G06N3/008G06T13/40G06F16/90332
Inventor 尚小维
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap