Three-dimensional human face action detecting and tracing method based on video stream

Abstract

The invention provides a method for detecting and tracing three-dimension face action based on video stream. The method include steps as follows: detecting face and a key point position on the face; initializing the three-dimension deformable face gridding module and face texture module used for tracing; processing real time, continuous trace to the face position, gesture and face action in follow video image by using image registering with two modules; processing evaluation to the result of detection, location and tracking by using a PCl face sub-space, if finding the trace is interrupted, adopting measure to restore trace automatically. The method does not need to train special user, has wide head gesture tracing range and accurate face action detail, and has certain robustness to illumination and shelter. The method has more utility value and wide application prospect in the field, such as human-computer interaction, expression analysis, game amusement.

Description

technical field [0001] The invention relates to the field of face detection and tracking, in particular to a method for detecting and tracking three-dimensional human faces and human face actions in video streams. Background technique [0002] Face is an important feature that everyone has. It is one of the most natural and commonly used means of interaction. It has a wide range of applications in the fields of computer vision and graphics, such as human-computer interaction, security monitoring, game entertainment, and computer animation. Wait. Real-time and accurate detection and tracking of human faces and facial movements is of great significance both in theory and in practice. How to build an effective model, select the most expressive features, construct an accurate classifier, and implement an efficient and stable tracking algorithm are all theoretical issues that people care about. If accurate detection and tracking results of human faces and facial movements can b...

AI Technical Summary

Problems solved by technology

In terms of tracking accuracy, it is difficult for the existing technology to achieve high accuracy, which is reflected in the insufficient ability to describe the shape of facial organs and details of movements

In terms of tracking stability, many tracking methods cannot converge to the correct result when the head movement range is large, or the movement speed is too fast, or the facial expression is large.

In terms of practicality, the existing technology still lacks a complete and effective solution for the combination of detection, positioning and tracking

Images