Multi-mode interaction output method and system based on virtual human

A virtual human and multi-modal technology, applied in the field of artificial intelligence, can solve the problems of imitation, unrealistic, smooth, anthropomorphic, and multi-modal interaction, so as to enhance viscosity, improve interactive experience, and smooth simulated interaction effect of effect

Inactive Publication Date: 2018-04-20
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF9 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The virtual robots in the prior art cannot perform multi-modal interaction, and always present a fixed state, let alone imitate the emotions and emoti

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-mode interaction output method and system based on virtual human
  • Multi-mode interaction output method and system based on virtual human
  • Multi-mode interaction output method and system based on virtual human

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the application. However, the present application can be implemented in many other ways different from those described here, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

[0046] In this application, a virtual human-based multi-modal interactive output method and system, a virtual human, a smart device, and a computer-readable storage medium are provided, which will be described in detail in the following embodiments. .

[0047] In this application, the virtual human is an intelligent device equipped with input and output modules that support perception, control, etc.;

[0048] With high-simulation 3D virtual character images as the main user interface, it has an appearance with disti...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-mode interaction output method and system based on virtual human. The multi-mode interaction output method based on virtual human includes the steps: the virtual human is operated in intelligent equipment, acquires multi-mode data which at least includes voice data, and analyzes the multi-mode data so as to obtain the semantic data and the emotion data in the voice data, wherein the semantic data and the emotion data match the face parameters of the virtual human to generate the face bionic data and output the face bionic data. The multi-mode interaction output method and system based on virtual human can perform analysis of semantic data and emotion data on the obtained multi-mode data to enable the face of the virtual human to simulate the face action and the face emotion according to the analysis result, thus increasing the viscosity of visual sense of a user, showing lifelike and smooth simulation interaction effect, and improving the interaction experience.

Description

technical field [0001] The present application relates to the field of artificial intelligence technology, and in particular to a virtual human-based multimodal interactive output method and system, a virtual human, an intelligent device, and a computer-readable storage medium. Background technique [0002] With the continuous development of science and technology, the introduction of information technology, computer technology and artificial intelligence technology, the research of robots has gradually gone out of the industrial field, and gradually expanded to the fields of medical care, health care, family, entertainment and service industries. And people's requirements for robots have also been upgraded from simple and repetitive mechanical actions to intelligent robots with anthropomorphic question-and-answer, autonomy, and interaction with other robots. Human-computer interaction has become an important factor in determining the development of intelligent robots. [00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06N3/00G10L15/26G10L25/63G06F17/27
CPCG06N3/008G10L15/26G10L25/63G06F40/30
Inventor 徐强尚小维
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap