Virtual object facial animation generation method and device thereof, storage medium and terminal

Abstract

The invention discloses a virtual object facial animation generation method and a device thereof, a storage medium and a terminal, and the method comprises the steps: receiving a to-be-processed image frame which comprises a facial image of an actor; reconstructing a three-dimensional face of the actor based on a preset three-dimensional face model and the face image, wherein the preset three-dimensional face model is used for describing facial expression changes of the actor; extracting a plurality of three-dimensional feature points from the three-dimensional face; determining animation data corresponding to the plurality of three-dimensional feature points based on a mapping relationship between the three-dimensional feature points and the animation data; and generating an expression of a corresponding virtual object face based on the animation data, wherein the generated expression of the virtual object face is consistent with an expression made by the actor in the face image. According to the scheme, an efficient and high-precision virtual object face animation generation scheme can be provided, and the expression similarity between the generated virtual object face and the real face of an actor is high.

Description

technical field [0001] The present invention relates to the technical field of virtual digital objects, in particular to a method and device for generating facial animation of virtual objects, a storage medium, and a terminal. Background technique [0002] Facial capture (referred to as face capture) animation technology mainly includes offline facial animation production and real-time driving of facial expressions of virtual characters. [0003] In the traditional animation production process, in order to produce high-quality facial animation, not only requires animators to have high production capabilities, but also very time-consuming. In addition, in the traditional animation production process, it is impossible to drive the facial expressions of virtual characters in real time. [0004] In recent years, the face performance animation technology (ie, the aforementioned face capture animation technology) has been used to accelerate the production of offline animation by ...

AI Technical Summary

Problems solved by technology

[0005] However, the existing face-capture animation technology still has many problems such as time-consuming production, high labor costs, and low-quality faces of generated virtual objects.

Images