Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Multi-modal interactive processing method and system based on virtual person

A multi-modal, virtual human technology, applied in the field of human-computer interaction, can solve the problems such as the inability to achieve realistic, smooth and humanoid interaction effects, and the inability to carry out multi-modal interaction, so as to improve user experience and meet user needs.

Active Publication Date: 2018-04-10
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF8 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The virtual robot in the prior art cannot perform multi-modal interaction, and always presents a fixed state, unable to achieve realistic, smooth, and anthropomorphic interaction effects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal interactive processing method and system based on virtual person
  • Multi-modal interactive processing method and system based on virtual person
  • Multi-modal interactive processing method and system based on virtual person

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0033] figure 1 It is a schematic diagram of the application scenario of the virtual human-based multi-modal interaction system according to the embodiment of the present application. The virtual person A can be displayed to the user U in the form of a holographic image or a large-screen computer display interface through the smart device carried on it, and the virtual person A mainly responds to the user U during the multi-modal interaction process with the user U. U (especially fans of the celebrity) has a multimodal interaction intention to interact with the celebrity, activates a matching fan interaction skill, and outputs multimodal data matching the intent. In this embodiment, the system mainly includes a cloud brain (cloud server) 10 and a smart device 20 for multimodal interaction with the user U. The smart device 20 can be a traditional PC personal computer, LapTop notebook computer, holographic projection device, etc., or a terminal device that can be carried around...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-modal interactive processing method and system based on a virtual person. The virtual person runs on a smart device. The method includes the following steps that when the virtual person is in a wake-up state, the virtual person is displayed in a preset display area, and the virtual person has an appearance and attributes of a particular star character; multi-modal input data are acquired; a virtual person capability interface is called for parsing the multi-modal input data to obtain a multi-modal interaction intention of a user interacting with the star character; according to the respondence of social attributes, personality attributes and character skills of the star character to the multi-modal interaction intention, multi-modal data that match with theintention are determined; fan interaction skills that match with the intention are opened, and the multi-modal data that match with the intention are output. The method and system are not limited to online or offline scenarios, can achieve the multi-modal interaction between the virtual star and the user, can better meet user requirements, increase the interaction form between the virtual person and the user or star fans, and improve the user experience.

Description

technical field [0001] The invention relates to the field of human-computer interaction, in particular to a method and system for processing multi-modal interaction based on a virtual human. Background technique [0002] With the continuous development of science and technology, the introduction of information technology, computer technology and artificial intelligence technology, the research of robots has gradually gone out of the industrial field, and gradually expanded to the fields of medical care, health care, family, entertainment and service industries. And people's requirements for robots have also been upgraded from simple and repetitive mechanical actions to intelligent robots with anthropomorphic question-and-answer, autonomy, and interaction with other robots. Human-computer interaction has become an important factor in determining the development of intelligent robots. [0003] At present, robots include physical robots with entities and virtual robots mounted ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/0487G06F3/0481G06F17/30
CPCG06F3/011G06F3/0481G06F3/0487G06F2203/011G06F16/3329G06F16/334G06F16/338
Inventor 尚小维李晓丹
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com