Expression cloning method and device capable of realizing real-time interaction with virtual character

A technology of virtual character and cloning method, applied in the fields of virtual reality and computer graphics, it can solve the problems of excessive calculation and too many vertices, and achieve the effect of good scalability.

Active Publication Date: 2016-06-08
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF3 Cites 47 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Fusion deformation is a method based on skin mesh deformation. Based on the basic expression and the corresponding weight, the new spatial position of ea

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Expression cloning method and device capable of realizing real-time interaction with virtual character
  • Expression cloning method and device capable of realizing real-time interaction with virtual character
  • Expression cloning method and device capable of realizing real-time interaction with virtual character

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0026] The invention provides an expression cloning method for realizing real-time interaction with a virtual character, including a data preparation stage and an expression generation stage.

[0027] The data preparation stage mainly includes the following steps. There are three steps: character modeling, virtual character basic expression library establishment, and input model training.

[0028] Among them, the role modeling step is to model the virtual character in 3D software, and bind the bones to it, and set the appropriate weight for the patch corresponding to each bone, so that the bones and their controllers can be operated , can get a relatively natural expression. Depending on the needs, the whole body can be...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an expression cloning method and device capable of realizing real-time interaction with a virtual character and belongs to the fields such as computer graphics and virtual reality. The method includes the following steps that: 1, modeling and skeleton binding are performed on the virtual character; 2, the basic expression base of the virtual character is established; 3, expression input training is carried out: the maximum displacement of facial feature points under each basic expression is recorded; 4, expression tracking is carried out: the facial expression change of a real person is recorded through motion capture equipment, and the weights of the basic expressions are obtained through calculation; 5, expression mapping is carried out: the obtained weights of the basic expressions are transferred to the virtual character in real time, and rotation interpolation is performed on corresponding skeletons; and the real-time rendering output of the expression of the virtual character is carried out. With the method adopted, the expression of the virtual character can be synthesized rapidly, stably and vividly, so that the virtual character can perform expression interaction with the real person stably in real time.

Description

technical field [0001] The invention relates to the fields of computer graphics and virtual reality, in particular, an expression cloning method and device capable of real-time interaction with virtual characters. Background technique [0002] With the continuous development of virtual reality technology, virtual character animation is often used in many important fields such as animation, film and television, games, etc., especially entertainment games that require human-computer interaction. The animation of virtual characters includes body animation and facial expression animation. In order to realize the realistic effect of virtual characters, pure body animation can no longer meet the needs of users. Realistic facial animation is an important factor to improve user experience. [0003] Expression cloning refers to reappearing real expressions into virtual characters in real time, so as to achieve the purpose of interacting with virtual characters. Fast, stable, and rea...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T13/40G06T15/00
CPCG06T13/40G06T15/005
Inventor 王雨萌王政徐波
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap