Facial feature point positioning method, device, apparatus and medium based on cascade regression

A cascade regression, facial feature technology, applied in the field of image processing, can solve the problems of poor training effect of face image texture information model, low facial feature point positioning accuracy, poor effect, etc., so as to improve the utilization effect and improve the Accuracy and accuracy, the effect of improving the training effect

Active Publication Date: 2018-12-21
SHENZHEN UNIV
View PDF7 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The object of the present invention is to provide a facial feature point location method based on cascade regression, device, equipment and storage medium, aiming to solve the problem that the facial feature point location method based on cascade regression in the prior art cannot make good use of human The texture information of the face image and the model training effect are not good, resulting in the problem of low accuracy and poor effect of facial feature point positioning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial feature point positioning method, device, apparatus and medium based on cascade regression
  • Facial feature point positioning method, device, apparatus and medium based on cascade regression
  • Facial feature point positioning method, device, apparatus and medium based on cascade regression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] figure 1 It shows the implementation flow of the method for locating facial feature points based on cascaded regression provided by Embodiment 1 of the present invention. For the convenience of explanation, only the parts related to the embodiment of the present invention are shown, and the details are as follows:

[0027] In step S101, when a facial feature point location request is received, the face image to be positioned in the facial feature point location request is acquired.

[0028] The embodiments of the present invention are applicable to facial feature point positioning platforms or systems. Obtain the face image to be located in the facial feature point positioning request, and then perform facial feature point positioning on the face image to be located.

[0029] In step S102, the multi-scale convolutional neural network in the pre-trained cascade regression model is used to predict the set of feature points of the face image to be located and extract the ...

Embodiment 2

[0070] image 3 The structure of the cascaded regression-based facial feature point locating device provided in Embodiment 2 of the present invention is shown. For the convenience of description, only the parts related to the embodiment of the present invention are shown, including:

[0071] The image-to-be-located acquisition unit 31 is configured to acquire the face image to be located in the facial feature point location request when receiving the facial feature point location request.

[0072] The feature point information extraction unit 32 is used to predict the set of feature point positions of the face image to be positioned and extract the global features of the face image to be positioned through the multi-scale convolutional neural network in the pre-trained cascade regression model. The joint regression model is trained through a preset deep optimization strategy based on the Jacobian matrix.

[0073] In the embodiment of the present invention, the cascade regress...

Embodiment 3

[0114] Figure 5 The structure of the image processing device provided by the third embodiment of the present invention is shown, and for the convenience of description, only the parts related to the embodiment of the present invention are shown.

[0115] The image processing device 5 of the embodiment of the present invention includes a processor 50 , a memory 51 , and a computer program 52 stored in the memory 51 and operable on the processor 50 . When the processor 50 executes the computer program 52, the steps in the above-mentioned method embodiments are realized, for example figure 1 Steps S101 to S104 are shown. Alternatively, when the processor 50 executes the computer program 52, the functions of the units in the above-mentioned device embodiments are realized, for example image 3 Function of units 31 to 34 shown.

[0116] In the embodiment of the present invention, the multi-scale convolutional neural network in the trained cascade regression model is used to pre...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

As that invention is applicable to the field of computer technology, A facial feature point localization method based on cascade regression is provided, a device, an apparatus and a medium are provided. The method comprises: Through the multi-scale convolution neural network in the trained cascade regression model, predicting a feature point position set of a face image to be located and extracting a global feature of the image, according to the global feature, modifying the feature point position set of the face image to be located by each refinement layer in the cascade regression model, according to the corrected feature point position set, the final position of all feature points on the face image to be located is determined, Among them, the cascade regression model is based on the Jacobian matrix in-depth optimization strategy training, Each refinement layer includes a local feature extractor, a feature fusion device and a regressor, which improves the effect of image texture information utilization and model training in the process of facial feature point positioning, and further improves the accuracy and accuracy of facial feature point positioning.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a method, device, equipment and medium for locating facial feature points based on cascade regression. Background technique [0002] Facial feature point location is an important part of face animation generation based on face images. Usually, a reliable and fast face detection algorithm first gives the face area as input, and then a set of presets in the face area Locate the defined facial feature points, such as eyebrows, eye pupils, nose tip, mouth corners, etc. At present, the facial feature point localization methods are mainly divided into two types of models: the generative model represented by the classic algorithm active appearance model, and the discriminative model represented by the cascaded regression method (such as the supervised descent method) that has emerged in recent years. The generative model often fails when locating the feature points...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/168G06F18/214
Inventor 朱美芦石大明
Owner SHENZHEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products