Multi-modal interaction-based data processing method and system deduced by virtual idol

A multi-modal and idol technology, applied in the direction of image data processing, electrical digital data processing, data processing input/output process, etc., can solve the problem that virtual robots cannot achieve lifelike, smooth, anthropomorphic, and deductive data and skills. There are problems such as correspondence and poor human-computer interaction effect, so as to achieve the effect of good human-computer interaction effect

Inactive Publication Date: 2018-05-18
BEIJING GUANGNIAN WUXIAN SCI & TECH
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, the multi-modal interaction and skill output of virtual robots do not have real-time performance, and there is no correspondence between deductive data and skill content, and virtual robots cannot achieve realistic, smooth, and anthropomorphic effects, and the effect of human-computer interaction is poor.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal interaction-based data processing method and system deduced by virtual idol
  • Multi-modal interaction-based data processing method and system deduced by virtual idol
  • Multi-modal interaction-based data processing method and system deduced by virtual idol

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the application. However, the present application can be implemented in many other ways different from those described here, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

[0038] The present application provides a multi-modal interaction-based virtual idol deduction data processing method and system, a virtual idol, an imaging device, and a computer-readable storage medium, which will be described in detail in the following embodiments.

[0039] see figure 1 , a schematic structural diagram of a virtual idol deduction data processing system based on multi-modal interaction provided by an embodiment of the present application, which realizes that when the current virtual idol deduction ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-modal interaction-based data processing method and system deduced by a virtual idol. The method comprises the steps of acquiring multi-modal input data, inputting the multi-modal input data to a pre-established deep learning model for matching to obtain multi-modal output data, outputting the multi-modal output data, and deducing the multi-modal output data by the virtual idol. Therefore, skill data are analyzed through a cloud server in a case that a current virtual idol deductive skill is enabled, and the multi-modal output data is decision-made. The multi-modal output data are displayed by the virtual idol through imaging equipment so that deduction of the virtual idol has real-time performance and the deduction data and the skill content are correspondent, a user can also enjoy smooth individualized experience and the human-computer interaction effect is good.

Description

technical field [0001] The present application relates to the field of artificial intelligence technology, and in particular to a multimodal interaction-based virtual idol deduction data processing method and system, a virtual idol, an imaging device, and a computer-readable storage medium. Background technique [0002] With the continuous development of science and technology, the development of robots has gradually expanded from the industrial field to medical, health care, family, entertainment and service industries. People's requirements for the intelligence of robots are constantly improving so that they can serve humans better. [0003] Robots include real robots with entities and virtual robots mounted on hardware devices. The virtual robot in the prior art can only complete some preset actions by programming it, and has a low degree of intelligence. [0004] At present, the multi-modal interaction and skill output of virtual robots are not real-time, and the inter...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/0481G06F3/0487G06F3/16G06T13/20G06T13/40G06T19/00
CPCG06F3/0481G06F3/0487G06F3/167G06T13/205G06T13/40G06T19/00
Inventor 贾志强俞晓君
Owner BEIJING GUANGNIAN WUXIAN SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products