Supercharge Your Innovation With Domain-Expert AI Agents!

Face key point detection method based on attention mechanism

A technology of face key points and detection methods

Active Publication Date: 2019-09-27
南京云智控产业技术研究院有限公司 +1
View PDF9 Cites 41 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above algorithm can improve the detection accuracy, but it will increase the complexity of the network accordingly and affect the speed of the detection algorithm
In addition, existing algorithms do not perform well in occlusion, large-pose face keypoint detection
[0004] Therefore, there are still the following problems in the field of face feature point detection on these data sets: 1) cannot effectively solve the detection of face key points under large poses, occlusions, and low resolution; 2) the detection accuracy of face key points Can't take care of speed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face key point detection method based on attention mechanism
  • Face key point detection method based on attention mechanism
  • Face key point detection method based on attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Below in conjunction with accompanying drawing, technical scheme of the present invention is described in further detail:

[0039] Such as Figure 1 to Figure 10 As shown, the present invention provides a kind of face key point detection method based on attention mechanism, comprises following concrete steps:

[0040] Step (1): If figure 1 As shown, according to steps S101-S102, according to the face detection frame given in the data set, the original image is cropped, and the cropped image is normalized to 256×256×3px, and the data is enhanced to obtain the training sample . Among them, the enhancement methods mainly include random rotation (-30°-30°), horizontal flip (50% probability), Gaussian blur, adjustment of brightness, and adjustment of contrast.

[0041] Step (2): The main network of the present invention uses a residual network (ResNet) and is initialized with an official pre-trained model, so it is easier to optimize. The structure of the residual networ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a face key point detection method based on an attention mechanism. The method comprises the following steps: establishing a multi-channel feature extraction network structure oriented to multi-resolution input; designing an attention module, introducing an attention mechanism by utilizing a feature fusion network with an hourglass structure, and selecting a key feature related to a task; and enabling the feature map output by the attention module to pass through a residual module, and outputting key point position information. According to the multi-channel feature extraction network oriented to multi-resolution input, relay supervision is introduced, so that the detection precision is ensured while the network depth is reduced; according to the attention module, the features are continuously focused to the region of interest by introducing an attention mechanism, and the face key point detection precision under shielding and large postures is improved. Experiments show that the method can effectively overcome the influence of large attitude and shielding on the precision, and solves the problem of network depth and detection speed equalization.

Description

technical field [0001] The invention relates to a human face key point detection method based on an attention mechanism, and belongs to the technical field of image processing. Background technique [0002] Face key point detection, also known as face key point positioning or face alignment, refers to marking the eyebrows, eyes, nose, mouth, and contour areas of a face based on a given face image. In scientific research and practical applications have received widespread attention. For example, face posture correction, posture recognition, expression recognition, fatigue monitoring, mouth shape recognition, face beauty, etc. There are many publicly available face datasets, such as WFLW (98 points), Helen (194 points), 300W (68 points), IBUG (68 points), LFPW (29 points), AFLW (21 points), etc. , which can be directly used in the research of face key point detection algorithm. [0003] Considering that the convolutional neural network has a strong feature expression abilit...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/084G06V40/172G06V40/161G06V40/168G06V10/462G06N3/045G06F18/253G06F18/214Y02D10/00
Inventor 王腾童心洁薛磊
Owner 南京云智控产业技术研究院有限公司
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More