Method for tracing position and pose of 3D human face in video sequence

Abstract

The invention provides a method for tracing the position and pose of a 3D human face in a video sequence. In the method, based on the principal component analysis, by using a deformable 3D grid model, minimizing the distance between a key point on the grid model and a corresponding key point on an input image, the model can fit the head figure of a user; the human face texture can be obtained by using the 3D model at an initial phase, so as to render human face images under different poses; the feature points can be selected in the rendered images, and a corresponding position can be searched on the input image; the matching faults can be removed by using a random sampling mode; then, mode pose changed parameters can be estimated according to the corresponding relationship between the feature points, so as to update a hypothetical state; finally, a distance between the rendered image and an actual image can be calculated by using the average normalized correlation algorithm, so as to calculate a hypothetical weight. Experiments show that the method can effectively trace the pose of the 3D head in the video.

Description

technical field [0001] The invention relates to the fields of face detection, positioning and tracking, in particular to a method for tracking the three-dimensional position and attitude parameters of a human face in a video stream. Background technique [0002] Face is an important feature that everyone has. It is one of the most natural and commonly used means of interaction. It has a wide range of applications in the fields of computer vision and graphics, such as human-computer interaction, security monitoring, game entertainment, and computer animation. Wait. Accurate detection and tracking of human faces is of great significance both in theory and in practice. How to build an effective model, select the most expressive features, construct an accurate classifier, and implement an efficient and stable tracking algorithm are all theoretical issues that people care about. If accurate detection and tracking results of human faces and facial movements can be obtained, they...

AI Technical Summary

Problems solved by technology

In addition, when the face position, posture or action parameters change drastically, the detection and tracking results will often produce large errors.

Images