Face fitting method based on three-dimensional deformation model

Abstract

The invention puts forward a face fitting method based on a three-dimensional deformation model. The method comprises the main contents of the three-dimensional deformation model, scaled orthographicprojection, a perspective camera model and a shape from a sign. The method comprises the process that: firstly, from a shape parameter, determining the vertex position of the three-dimensional deformation model, wherein the shape is described by a linear subspace model in data via principal component analysis; then, using an axial vector to carry out parameterization on a rotation matrix, enablingan interval space to be constant, and simulating calibration lacking information; finally, assuming that the sign corresponds to the vertex in the deformation model, finding a shape, a gesture and acamera parameter, and minimizing the sum of squared distances on all signs; and importing target functions under an orthographic and perspective situation, and expressing the target functions as a separable nonlinear least square problem. By use of the method, the model is fit to server as the separable nonlinear least square problem, one series of problems brought by light, shape shielding and the like can be solved, the calibration lacking information is effectively simulated, and face fitting is quick and accurate.

Description

technical field [0001] The invention relates to the field of face fitting, in particular to a face fitting method based on a three-dimensional deformation model. Background technique [0002] With the development of society, the requirements for fast and efficient automatic identity verification are increasingly urgent. The use of face fitting technology for face detection, face representation, face identification, expression and posture analysis, physiological classification, etc. has the advantages of directness, friendliness and convenience, and is easy to be accepted by users. Face fitting technology can automatically process multi-ethnic facial features, and is widely used in various fields, such as face recognition systems, medicine, movies and TV shows, advertisements, computer animation, games, video conferencing, video telephony, human-computer interaction, etc. In the field of public security, face reconstruction and recognition technology based on face fitting is...

AI Technical Summary

Problems solved by technology

[0004] Aiming at the problem of shape shading and the inability to eliminate the influence of light on face fitting, the purpose of the present invention is to provide a face fitting method based on a three-dimensional deformation model. First, the vertex position of the three-dimensional deformation model is determined by the shape parameters, and the shape is determined by using PCA starts from the linear subspace model description in the data, then parameterizes the rotation matrix with the axial vector, then makes the spacing distance constant, simulates the lack of calibration information, and finally assumes that the markers correspond to vertices in the deformed model, finds the shape, pose and camera parameters, minimizing the sum of squared distances over all markers; introducing objective functions for the orthographic and perspective cases, formulating them as separable nonlinear least-squares problems

Images