A face key point positioning method with shielding robustness

A technology of face key point and positioning method, applied in the field of face key point positioning

Active Publication Date: 2019-06-14
ZHEJIANG UNIV
View PDF9 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Although there are many relatively mature algorithms for face key point positioning under medium pos

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A face key point positioning method with shielding robustness
  • A face key point positioning method with shielding robustness
  • A face key point positioning method with shielding robustness

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0093] In this embodiment, it mainly includes an input image preprocessing module, a first part of a rough positioning module, a second part of a fine positioning module, and a third part of a binary coordinate regression module, through which an accurate positioning result is finally obtained. A method for occlusion-robust facial key point location includes the following steps:

[0094] 1. Carry out the data collection and labeling of the aforementioned step S1: In this embodiment, the open source face image data sets 300W, 300VW, COFW and AFLW are integrated, and some face pictures under the situation of occlusion and large posture (self-occlusion) are collected by oneself , using the existing high-precision 3DDFA algorithm to mark the key points of the face, and then manually screen, and manually adjust some inaccurate key points.

[0095] 2. Perform the preprocessing of the aforementioned step S2: read the face image and the key point ground truth label, first calculate th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a shielding robust face key point positioning method, and belongs to the field of face key point positioning. The method comprises the following steps of S1, collecting face images marked by key points as a training data set and a test data set; S2, for the training data set and the test data set in the step S1, firstly carrying out face detection and five-point key point positioning by using a face detection algorithm MTCNN, and then converting a face by using Procrustes analysis transformation T to obtain a corrected face sample so as to form a training sample and a test sample; taking the corrected face sample as the input of the S3 stage; S3, learning the training sample in the step S2 through a convolutional network; and S4, after the convolutional network completes the training in the step S3, inputting the test sample in the step S2 into the convolutional network, and obtaining the positions of the face key points in the image. The method has robustness for face key point positioning under the shielding condition, and the test result and the qualitative positioning result of the corresponding picture also prove the effectiveness of the method.

Description

technical field [0001] The invention belongs to the field of human face key point positioning, and in particular relates to an occlusion robust human face key point positioning method. Background technique [0002] Face key point positioning technology is based on face images. First, it detects whether there is a face on the input face image or video stream. If there is a face, it further gives the position of each face and the position of key points, such as The location of the major facial organs such as the nose, eyes, and mouth. This technology can be used for face pose correction, pose recognition, fatigue monitoring, 3D face reconstruction, face animation, face recognition, expression analysis, etc. Wrong key point positioning will lead to face distortion and deformation, so an algorithm that can accurately extract face key points is very important. The whole process includes face detection, face preprocessing, face key point positioning and other modules. [0003] ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
Inventor 吴思王梁昊李东晓张明
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap