Facial shape tracking method based on space-time cascade shape regression

A cascading, spatiotemporal technology, applied in computer vision technology and multimedia fields, can solve problems such as face registration errors, face registration failures, and error accumulation, and achieve the effects of smoothing noise, saving time, and improving accuracy.

Inactive Publication Date: 2016-07-20
NANJING UNIV OF INFORMATION SCI & TECH
View PDF3 Cites 26 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, face registration based on static images has achieved good results, and the speed and accuracy have been greatly improved. However, when the existing algorithms are directly applied to videos, there are still many challenges, mainly from video sequences. Changes in facial expression, illumination, occlusion, and posture
Compared with the face registration of

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial shape tracking method based on space-time cascade shape regression
  • Facial shape tracking method based on space-time cascade shape regression
  • Facial shape tracking method based on space-time cascade shape regression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] Embodiments of the present invention are described in detail below, examples of which are in the appended figure 1 , wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present invention and should not be construed as limiting the present invention.

[0029] Such as figure 1 As shown, it is an overall flowchart of the face shape tracking method based on spatiotemporal cascade shape regression of the present invention, including the following steps:

[0030] Step 1. Face detection

[0031] The face detector combined with detection and registration performs face detection on the first frame of the video, and obtains five feature points.

[0032] Step 2. Face Pose Estimation

[0033] The current face posture is estimated by performing specific calculations on the five feature poi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention discloses a facial shape tracking method based on space-time cascade shape regression. The method comprises: detecting the first frame of a video through combination of a face detector configured to detect and register, initializing the whole system, and obtaining five facial feature points; assessing the five facial feature points to obtain similar transformation parameters (rotation, offset and scale) and face poses (left sides of the faces, right sides of the faces and the faces); and employing multi-view cascade shape regression to predicate the face shape of the current frame, when the registering result confidence is larger than a setting threshold, allowing the time sequence regression to set about tracking the face shapes, and when the registering result confidence is smaller than a setting threshold, starting a re-initialization mechanism to perform stable tracking of the face shapes. The facial shape tracking method based on space-time cascade shape regression is faster in convergence speed and higher in precision through the multi-view (the left side of the face, the right side of the face and the face) cascade regression, and faster in the face shape tracking speed and more accurate in the face shape tracking through the time sequence regression and the re-initialization mechanism.

Description

technical field [0001] The invention relates to a face shape tracking method based on space-time cascade shape regression, and belongs to the fields of computer vision technology and multimedia technology. Background technique [0002] Registration in video is the basis of video analysis. After accurate registration of faces in video, facial expression analysis, face recognition, face pose estimation, and individual behavior identification can be performed. At present, face registration based on static images has achieved good results, and the speed and accuracy have been greatly improved. However, when the existing algorithms are directly applied to videos, there are still many challenges, mainly from video sequences. Changes in facial expression, illumination, occlusion, and posture. Compared with the face registration of a single image, the face registration in the video needs to fully consider the relationship between two adjacent frames. If the registration deviation o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/161G06V40/172G06V10/76G06F18/22
Inventor 刘青山卢宗光张开华杨静
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap