A Multi-Face Feature Point Localization Method Based on a Single Convolutional Neural Network

A convolutional neural network and facial feature technology, applied in the field of facial multi-feature point positioning, can solve the problems of difficult positioning accuracy, complex structure and training process, and high data set requirements, achieving good positioning effect, simplifying the network structure, The effect of high precision and performance

Active Publication Date: 2021-04-16
NANJING UNIV OF SCI & TECH
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, multi-task learning is more demanding on datasets and complex training cannot be repeated
[0005] Obviously, the structure and training process of the above network are very complicated; secondly, most of the existing deep learning-based methods are aimed at positioning a small number of feature points.
When the number of feature points increases, the accuracy of positioning will become more difficult

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Multi-Face Feature Point Localization Method Based on a Single Convolutional Neural Network
  • A Multi-Face Feature Point Localization Method Based on a Single Convolutional Neural Network
  • A Multi-Face Feature Point Localization Method Based on a Single Convolutional Neural Network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0090] combine Figure 1~4 , the present invention is based on the facial multi-feature point localization method of single convolutional neural network, comprises the following steps:

[0091] Step 1. Expand training samples; in order to solve the problem of lack of training pictures and avoid serious overfitting, it is necessary to expand training samples.

[0092] Step 2. Determine the face frame according to the facial feature point coordinates corresponding to each sample provided by the data set. Since the images in the original library include a variety of backgrounds, the face frame is first determined according to the facial feature point coordinates corresponding to each sample provided by the dataset. The specific processing method (pseudo code) is as follows:

[0093]

[0094] Step 3. Sample the four operations of scaling, rotation, translation and flipping to expand the data and make up for the lack of labeling of the training image feature points; the flippi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for locating facial feature points based on a single convolutional neural network. The method is as follows: expanding training samples; determining the frame of the face according to the facial feature point coordinates corresponding to each sample provided by the data set; Rotate, translate, and flip four operations to expand data and make up for the lack of training image feature point labeling; extract face images according to the face bounding box, and perform normalization processing; finally design the network structure, train the network, and set the network The learning rate and the amount of data processed each time complete the positioning of multiple feature points on the face. This method simplifies the network structure and reduces the difficulty of training. This network structure can extract more global advanced features, express facial feature points more accurately, and have a good positioning effect on facial feature points under complex conditions. At the same time, it can realize Localization of multiple feature points on the face.

Description

technical field [0001] The invention relates to the field of biometric identification, in particular to a method for locating multiple facial feature points based on a single convolutional neural network. Background technique [0002] Facial landmark localization is an important problem in computer vision, because many vision tasks rely on accurate facial landmark localization results, such as face recognition, facial expression analysis, facial animation, etc. Although it has been extensively studied over the years, and with great success. However, due to the complex diversity of face images caused by factors such as partial occlusion, illumination, large head rotation, and exaggerated expression changes, facial landmark localization still faces great challenges. Convolutional neural networks have proven to be effective in feature extraction and classification, while it has also been shown to be robust against occlusions. [0003] Facial landmark localization methods are ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/171G06N3/045
Inventor 练智超朱虹李德强
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products