Method for fast constructing high-accuracy personalized face model on basis of facial images

Abstract

The invention discloses a method for fast constructing a high-accuracy personalized face model on the basis of facial images, which belongs to the cross field of computer vision and computer graphics, and aims at achieving the purposes of fast reconstructing a personalized 3D geometrical facial model and a high-accuracy 2D facial texture mapping on the basis of real facial images. The method comprises the following steps: firstly, shooting five facial images from multiple angles; secondly, marking positions and corresponding relationships of forty-one characteristic points on the facial images and a neutral facial model; thirdly, aligning the projection of the neutral facial model on a virtual camera focal plane with the facial images; fourthly, carrying out hierarchical geometrical deformation on the neutral facial model to obtain the personalized geometrical facial model; and finally, synthesizing the high-accuracy facial texture mapping according to the five facial images. The face modeling method has the advantages of convenience for data acquisition, high modeling speed and modeling accuracy, and the like, and achieves higher practical values in the fields of video communication, electronic games, man-machine interaction, and the like.

Description

technical field [0001] The patent of the present invention relates to the interdisciplinary field of computer vision and computer graphics, in particular to a method for quickly constructing a high-precision personalized face model from a face image. Background technique [0002] Advances in computer vision and computer graphics technology have promoted the birth and development of the interactive digital media industry. As the representative of the participants in the virtual world, the virtual character substitutes the characters in the real world into the virtual world, and has a wide range of applications in the fields of film and television production, game entertainment, and video communication. Human face is one of the most important parts of human beings to express feelings, temperament and emotions, and it has the characteristics of individuality, diversity and visualization. With the continuous improvement of people's requirements for the entertainment and realism...

AI Technical Summary

Problems solved by technology

This device has been successfully applied in the special effects production of the movie "Avatar" and "The Digital Emily" project. Although the face model reconstructed by it is very real, the face modeling time is long and the modeling cost is also high. See O .Alexander, M.Rogers, W.Lambeth, M.Chiang, P.Debevec, Creating a Photoreal Digital Actor: The Digital Emily Project, SIGGRAPH 2009 Course Notes: The Digital Emily Project, 12:1-12:15

In order to reduce the complexity of face modeling, some researchers use 7 digital cameras to take a group of face images at one time, and then use the principle of stereo vision to reconstruct the face model, see T.Beeler, B.Bickel, P.Beardsley, M.Gross, High Quality Single-Shot Capture of Facial Geometry, ACM Transactions on Graphics, 29(4): 40: 1-40: 9, but the production cost of this method is still high

Some researchers also propose to use a face photo to construct a face model. Although the modeling operation is simple and practical, the reconstructed face model is often less accurate. See Y.Ye, M. Zhang, H. Li, R. Jiang, X.Tang, Z.Pan, EasyFace: a Realistic Face Modeling and Facial Animation Authoring System, Proceeding of VRCAI 2009, 113-117

[0005] The above face modeling methods either have high modeling costs, long modeling cycles, or low modeling accuracy, and cannot provide higher modeling accuracy and faster modeling while ensuring lower modeling costs. modeling speed

Images