Cascaded neural network-based face key point detection method

A face key point and neural network technology, which is applied in the field of face key point detection based on cascaded neural network, can solve problems such as illumination changes, pose changes that are not enough Lubang, sensitivity to subtle disturbances, and waste of computing resources

Inactive Publication Date: 2014-05-28
BEIJING KUANGSHI TECH
View PDF1 Cites 125 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in practical applications, these two types of algorithms have their own great defects: 1) For the first type of algorithm, since each key point is detected separately, the global geometric information of the face is completely ignored, which makes it difficult for Very sensitive to subtle disturbances, not enough for Lubang
At the same time, this type of algorithm uses a lot of redundant information, like using features near the mouth and nose to detect key points of the eyes, which actually wastes a lot of computing resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Cascaded neural network-based face key point detection method
  • Cascaded neural network-based face key point detection method
  • Cascaded neural network-based face key point detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present invention will be further described below through specific embodiments and accompanying drawings.

[0032] The face key point detection method based on the cascaded neural network of the present invention, its specific process is as follows figure 1 As shown, its specific description is as follows:

[0033] a) Establish a face image set A for training, in which each face is manually marked with key point positions to be detected;

[0034] b) Construct the first layer of deep neural network (see figure 2 ) to train a face area estimation model. In this model, any face is divided into two parts: the inner face area (including eyebrows, eyes, nose, mouth) and the outer face area (including the complete face contour);

[0035] figure 2 is a schematic diagram of a single-layer deep neural network. like figure 2 As shown, each layer of deep neural network is composed of three parts: the convolutional layer Con, the maximum sampling layer Mp and the fully c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a cascaded neural network-based face key point detection method. The method includes the following steps that: a) a training-used face image set is established, and a key point position requiring detection is marked; b) a first-layer depth neural network is constructed and is used to train a face region estimation model; c) a second-layer depth neural network is constructed and is used to perform face key point preliminary detection; d) local region division is continued to be performed on an inner face region; e) a third-layer depth neural network is constructed for each local region respectively; f) the rotation angle of each local region is estimated; g) correction is performed according to the estimated rotation angles; h) a fourth-layer depth neural network is constructed for the correction data set of each local region; and i) any face image is given, and the above four-layer depth neural network model is adopted to perform key point detection, such that final face key point detection results can be obtained. With the cascaded neural network-based face key point detection method of the invention adopted, face key point detection can be improved, and especially the accuracy and real-time property of dense face key point detection.

Description

technical field [0001] The invention belongs to the technical field of digital image processing and face recognition, and in particular relates to a method for detecting key points of a face based on a cascaded neural network. Background technique [0002] Face key point detection (facial landmark detection), that is, given a face picture, it is necessary to accurately locate the position of a series of key points (such as pupils, eye corners, eyebrow corners, mouth corners, lip edges, etc.). As the most important step before face alignment, face key point detection will greatly affect the overall performance of face recognition / analysis / search systems. [0003] Traditional facial key point detection algorithms can be divided into two categories: the first type treats each key point as an independent part, and each key point trains the detector independently according to its local characteristics; the second type puts all key points in the Train together, focusing on the re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/66G06N3/02
Inventor 姜宇宁印奇曹志敏
Owner BEIJING KUANGSHI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products