Three-dimensional human face action detecting and tracing method based on video stream

A three-dimensional face and motion detection technology, applied in the field of face detection and tracking, can solve the problems of too fast movement, difficulty in achieving high precision, lack of solutions, etc., to achieve the effect of ensuring accuracy and fine motion tracking

Inactive Publication Date: 2009-08-05
INST OF AUTOMATION CHINESE ACAD OF SCI +1
View PDF0 Cites 75 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In terms of tracking accuracy, it is difficult for the existing technology to achieve high accuracy, which is reflected in the insufficient ability to describe the shape of facial organs and details of movements
In terms of tracking stability, many tracking methods cannot converge t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional human face action detecting and tracing method based on video stream
  • Three-dimensional human face action detecting and tracing method based on video stream
  • Three-dimensional human face action detecting and tracing method based on video stream

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] see figure 1 , the present invention provides a method for detecting and tracking human faces and human facial movements, which is implemented according to the following steps, wherein, steps (1) to (3) are detection and positioning stages, which occur in the first several frames of the input video sequence, and the steps (4)~(6) is the tracking stage, which occurs in each frame of the subsequent video sequence:

[0038] (1) Using the automatic face detection and positioning algorithm to detect and locate the face and key points of the face on the input video image.

[0039] The face detection method uses a face classifier combined with Adaboost and Cascade. This method is based on the literature (Viola P., Rapid object detection using a Boosted cascade of simple features, In Proc IEEE Conference on ComputerVision and Pattern Recognition, pp: 511- 518, 2001) to facilitate patent examination, and to help the public understand the invention more directly, for those who m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a method for detecting and tracing three-dimension face action based on video stream. The method include steps as follows: detecting face and a key point position on the face; initializing the three-dimension deformable face gridding module and face texture module used for tracing; processing real time, continuous trace to the face position, gesture and face action in follow video image by using image registering with two modules; processing evaluation to the result of detection, location and tracking by using a PCl face sub-space, if finding the trace is interrupted, adopting measure to restore trace automatically. The method does not need to train special user, has wide head gesture tracing range and accurate face action detail, and has certain robustness to illumination and shelter. The method has more utility value and wide application prospect in the field, such as human-computer interaction, expression analysis, game amusement.

Description

technical field [0001] The invention relates to the field of face detection and tracking, in particular to a method for detecting and tracking three-dimensional human faces and human face actions in video streams. Background technique [0002] Face is an important feature that everyone has. It is one of the most natural and commonly used means of interaction. It has a wide range of applications in the fields of computer vision and graphics, such as human-computer interaction, security monitoring, game entertainment, and computer animation. Wait. Real-time and accurate detection and tracking of human faces and facial movements is of great significance both in theory and in practice. How to build an effective model, select the most expressive features, construct an accurate classifier, and implement an efficient and stable tracking algorithm are all theoretical issues that people care about. If accurate detection and tracking results of human faces and facial movements can b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
Inventor 王阳生冯雪涛汪晓妍姚健丁宾
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products