Face key point positioning method and device

A technology of face key points and positioning method, which is applied in the field of face key point positioning based on global convolutional neural network, which can solve the problems of high time complexity, illumination change, robust occlusion, and ignoring global information of face shape.

Active Publication Date: 2020-03-17
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the traditional method has high positioning accuracy, it ignores the global information of the face shape, is not robust to illumination changes, occlusion, etc., and has a high time complexity, making it difficult to apply accurate key point positioning in large-scale scenes.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face key point positioning method and device
  • Face key point positioning method and device
  • Face key point positioning method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0074] The purpose of the present invention is to provide a key point localization method based on global convolutional neural network. In this method, the position sequence relationship between key points of different parts is added as a constraint into the neural network training to achieve accurate key point positioning.

[0075] According to one aspect of the present invention, a method for localizing key points based on a global convolutional neural network is provided, such as figure 1 shown, including the following steps:

[0076] Step S1, establish a face image training set, and manually calibrate the absolute coordinates S of the key point positions with the help of relevant calibration software g and head pose...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face key point positioning method and device. The method includes: performing rough positioning through a multi-task convolutional neural network to determine the general position of the key points of the face; then extracting local areas around the key points, and merging the extracted local areas around the key points together through a global cascaded convolutional neural network , perform cascade positioning; finally, train the convolutional neural network separately for each key point for fine positioning. The overall number of neural networks used in the present invention is relatively small, and the positioning effect is relatively good.

Description

technical field [0001] The invention relates to digital image processing, computer vision and other technical fields, in particular to a face key point positioning method and device based on a global convolutional neural network. Background technique [0002] Key point positioning (detection) is an important problem in computer vision, which refers to locating some key parts of the face with semantic structure information, such as eyes, nose and mouth, etc., which is an important part of supervised face alignment. A step of. Key point positioning also has many practical applications, such as face recognition, facial expression analysis, and human-computer interaction applications. Due to changes in head pose, facial expression, and lighting, keypoint localization remains a very challenging problem. The traditional key point detection algorithm based on convolutional neural network first uses an overall neural network to locate key points, and then isolates each key point s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/164G06V40/165G06F18/214
Inventor 孙哲南赫然谭铁牛李琦曹冬宋凌霄
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap