Single convolutional neural network-based facial multi-feature point locating method

A convolutional neural network and facial feature technology, applied in the field of facial multi-feature point positioning, can solve the problems of difficult positioning accuracy, complex structure and training process, and high data set requirements

Active Publication Date: 2018-03-16
NANJING UNIV OF SCI & TECH
View PDF9 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, multi-task learning is more demanding on datasets and complex training cannot be repeated
[0005] Obviously, the structure and training process of the above network are very complicated; secondly, m

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single convolutional neural network-based facial multi-feature point locating method
  • Single convolutional neural network-based facial multi-feature point locating method
  • Single convolutional neural network-based facial multi-feature point locating method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0090] combine Figure 1~4 , the present invention is based on the facial multi-feature point localization method of single convolutional neural network, comprises the following steps:

[0091] Step 1. Expand training samples; in order to solve the problem of lack of training pictures and avoid serious overfitting, it is necessary to expand training samples.

[0092] Step 2. Determine the face frame according to the facial feature point coordinates corresponding to each sample provided by the data set. Since the images in the original library include a variety of backgrounds, the face frame is first determined according to the facial feature point coordinates corresponding to each sample provided by the dataset. The specific processing method (pseudo code) is as follows:

[0093]

[0094] Step 3. Sample the four operations of scaling, rotation, translation and flipping to expand the data and make up for the lack of labeling of the training image feature points; the flippi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a single convolutional neural network-based facial multi-feature point locating method. The method comprises the steps of expanding training samples; according to facial feature point coordinates corresponding to the samples and provided by a data set, determining a human face boundary frame; expanding data by adopting four operations of zooming, rotation, translation and overturning to made up for the deficiency of feature point tagging of training images; according to the human face boundary frame, extracting a human face image, and performing normalization processing; and finally designing a network structure, training a network, setting a learning rate of the network and a data processing quantity each time, and finishing facial multi-feature point locating. According to the method, the network structure is simplified; the training difficulty is lowered; the network structure can extract more global advanced features and express facial feature points more accurately; the locating effect on the facial feature points under variable complex conditions is good; and the facial multi-feature point locating can be realized.

Description

technical field [0001] The invention relates to the field of biometric identification, in particular to a method for locating multiple facial feature points based on a single convolutional neural network. Background technique [0002] Facial landmark localization is an important problem in computer vision, because many vision tasks rely on accurate facial landmark localization results, such as face recognition, facial expression analysis, facial animation, etc. Although it has been extensively studied over the years, and with great success. However, due to the complex diversity of face images caused by factors such as partial occlusion, illumination, large head rotation, and exaggerated expression changes, facial landmark localization still faces great challenges. Convolutional neural networks have proven to be effective in feature extraction and classification, while it has also been shown to be robust against occlusions. [0003] Facial landmark localization methods are ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/171G06N3/045
Inventor 练智超朱虹李德强
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products