Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for generating virtual object facial animation, storage medium, and terminal

A virtual object and face technology, applied in animation production, computer parts, instruments, etc., can solve the problems of time-consuming production, high labor cost, and low quality of virtual object faces.

Active Publication Date: 2022-06-07
MOFA (SHANGHAI) INFORMATION TECH CO LTD +1
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the existing face-capture animation technology still has many problems such as time-consuming production, high labor costs, and low-quality faces of generated virtual objects.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for generating virtual object facial animation, storage medium, and terminal
  • Method and device for generating virtual object facial animation, storage medium, and terminal
  • Method and device for generating virtual object facial animation, storage medium, and terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] As mentioned in the background art, the existing facial capture animation technology still has many problems, such as time-consuming production, high labor cost, and low quality of the generated virtual object facial animation.

[0038] Through analysis, the inventors of the present application found that the existing facial performance animation technology (that is, face capture technology) is mainly divided into two categories: one is based on two-dimension (two-dimension, 2D for short) facial feature points; It is based on three-dimensional (three-dimension, 3D) face reconstruction.

[0039] Many of these technologies based on 2D facial feature points require animators to manually annotate 2D feature points on the captured face capture video. This step is very time-consuming, and the quality of manual annotations has a great impact on the final result. Moreover, this type of technology requires extremely high requirements for actors to wear helmets, not only to wear...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A virtual object facial animation generation method and device, a storage medium, and a terminal, the method comprising: receiving an image frame to be processed, the image frame including an actor's facial image; reconstructing based on a preset three-dimensional facial model and the facial image Obtaining the actor's three-dimensional face, the preset three-dimensional facial model is used to describe the facial expression changes of the actor; extracting a plurality of three-dimensional feature points from the three-dimensional face; based on the relationship between the three-dimensional feature points and animation data The mapping relationship is to determine the animation data corresponding to the plurality of three-dimensional feature points; generate the facial expression of the corresponding virtual object based on the animation data, and the generated facial expression of the virtual object is the same as that of the actor in the facial image The expressions you make are consistent. The scheme of the present invention can provide an efficient and high-precision virtual object facial animation generation scheme, and the generated virtual object's face has a high degree of similarity to the actor's real facial expression.

Description

technical field [0001] The invention relates to the technical field of virtual digital objects, in particular to a method and device for generating facial animation of a virtual object, a storage medium and a terminal. Background technique [0002] The facial capture (referred to as face capture) animation technology mainly includes two parts: offline facial animation production and real-time driving of the facial expressions of virtual characters. [0003] In the traditional animation production process, in order to produce high-quality facial animation, the animator not only needs high production ability, but also is very time-consuming. In addition, in the traditional animation production process, it is impossible to drive the facial expressions of virtual characters in real time. [0004] The face performance animation technology (that is, the aforementioned face capture animation technology) that has appeared in recent years accelerates the production of offline animat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T13/40G06V40/16
CPCG06T13/40G06V40/16G06T17/00G06F18/00
Inventor 柴金祥其他发明人请求不公开姓名
Owner MOFA (SHANGHAI) INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products