Real-time interactive intelligent digital virtual character expression driving method and system

A virtual character, real-time interaction technology, applied in the field of expression acquisition of virtual characters, can solve the problem of difficult application of expression capture methods, and achieve the effect of simplified generation

Inactive Publication Date: 2019-09-06
量子动力(深圳)计算机科技有限公司
View PDF6 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This process is very complicated, and this technology is difficult to apply to more generalized scenarios, especially with the rapid development of today's smart speakers, intelligent robots, chat robots, etc., the traditional expression capture method is difficult to apply

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time interactive intelligent digital virtual character expression driving method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] see figure 1 , in an embodiment of the present invention, a real-time interactive intelligent digital virtual character expression driving method, comprising the following steps:

[0024] S1, collect the user's voice information, and output the obtained voice information in a wireless or wired manner, here, the collection of voice information can be collected through devices such as smart speakers, smart robots, chat robots, and microphones;

[0025] S2. Analyze the obtained voice information. Preferably, the voice information is analyzed by the ASR module to obtain text information corresponding to the voice information, and perform semantic calculation on the text information and obtain a response at the same time. Here, the semantic calculation is performed by the NLP module. , after the semantic calculation of the NLP module is completed, the semantic information of the user can be known, and the existing voice interaction equipment has an automatic answering functi...

Embodiment 2

[0030] see figure 1 , in an embodiment of the present invention, a real-time interactive intelligent digital virtual character expression driving system includes a voice collection terminal 100, a cloud 200, an ASR module 201, an NLP module 202, and a TTS module 203. In this embodiment, the voice collection The terminal 100 communicates with the cloud 200 for collecting voice information of the user;

[0031] The ASR module 201, the NLP module 202 and the TTS module 203 are all set in the cloud 200, wherein:

[0032] The ASR module 201 is configured to analyze the obtained voice information to obtain text information corresponding to the user's voice information;

[0033] The NLP module 202 communicates with the ASR module 201, and is used to perform semantic calculation on the text information and obtain a response;

[0034] The TTS module 203 communicates with the NLP module 202 and is used to convert the response result into voice, and the voice is converted into emoticon...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time interactive intelligent digital virtual character expression driving method, and relates to the technical field of virtual character expression acquisition. The real-time interactive intelligent digital virtual character expression driving method comprises the following steps that S1, user speech information is collected, and the obtained speech information is outputted; S2, the obtained speech information is parsed to obtain text information corresponding to the speech information, the text information is subjected to semantic computation, and meanwhile a response is obtained; and S3, the obtained response is converted into speech, and the speech is converted into expression animation data in order to drive a virtual character to make a corresponding expression. The real-time interactive intelligent digital virtual character expression driving method has the beneficial effects that generation of expression animation is greatly simplified, the real-time interactive intelligent digital virtual character expression driving method can be widely applied to scenes such as intelligent speakers, intelligent robots, and chat robots so that the products are anthropomorphized, emotional interaction experience is achieved, and users can interact face to face with the virtual character.

Description

technical field [0001] The invention relates to the technical field of expression acquisition of virtual characters, in particular to a real-time interactive intelligent digital virtual character expression driving method and system. Background technique [0002] In industries such as film and television, service or games, when designing virtual characters, it is necessary to collect the expressions of actors as the basis for generating the expressions of virtual characters. [0003] The traditional facial expression capture system requires actors to wear special hardware devices. The hardware captures the actor’s facial expressions through sensors, digitizes facial expressions through algorithms, and finally transmits facial expression parameters to virtual characters, drives the virtual character’s facial expressions, and generates facial animations. This process is very complicated, and this technology is difficult to apply to more generalized scenarios, especially under ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L15/22G10L15/26G10L15/18G10L15/30G10L21/10G10L25/30G06T13/00
CPCG06T13/00G10L15/1822G10L15/22G10L15/26G10L15/30G10L21/10G10L25/30G10L2015/223
Inventor 王全伟
Owner 量子动力(深圳)计算机科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products