Face and face key point joint detection method based on transfer learning

A face key point, transfer learning technology, applied in the field of image processing and pattern recognition, can solve the problems of increased time-consuming MTCNN detection, low redundancy of lightweight network parameters, low recall rate, etc.

Active Publication Date: 2020-01-10
SOUTHEAST UNIV
View PDF3 Cites 41 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, as the scale of the face becomes smaller, the detection performance of MTCNN will drop sharply.
With the increase of faces in the image, the detection time of MTCNN will increase sharply
In general, the challenges of designing embedded face detection and face key point detection networks mainly include the following three aspects: First, there is a lot of redundancy in network parameters in traditional detection methods, which is not in line with embedded The main structure of the embedded network should be short and lean to meet the power consumption requirements of

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face and face key point joint detection method based on transfer learning
  • Face and face key point joint detection method based on transfer learning
  • Face and face key point joint detection method based on transfer learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] Preferred embodiments of the present invention are described below with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present invention, and are not intended to limit the protection scope of the present invention.

[0068] The invention discloses a joint detection method of lightweight human face and key points of human face, such as figure 1 shown, including the following steps:

[0069] Step 1, construct the network framework, and design the associated layer and size of the anchor box. Through a 5×5 convolution kernel with a step size of 2 and a 3×3 maximum pooling operation with a step size of 2, the receptive field of the small-scale feature layer is guaranteed and the computational load of the network is greatly reduced. At the same time, in order to allow the teacher network to obtain higher inference accuracy, the number of convolution kernel cha...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a rapid face and face key point joint detection method, comprising the following steps: 1, constructing a teacher network and a student network; 2, inputting a batch of training images, and carrying out data enhancement; 3, dividing positive and negative anchor frame samples according to a self-adaptive scale matching strategy; 4, mining positive and negative samples, calculating a multi-task loss function, and updating network parameters; 5, turning to the step 2 until the training converges to obtain a teacher network model; 6, repeating the steps 2 to 5, adding a transfer learning loss function by using the teacher network model, and training to obtain a student network model; and 7, in a test stage, inputting a test image to the student network model to obtain adetection result. The rapid face and face key point joint detection method can obtain face and key point detection results at the same time, and can increase the speed of the face recognition preprocessing process. The lightweight network provided by the invention is high in reasoning speed and can be deployed in embedded equipment with limited computing power.

Description

technical field [0001] The invention belongs to the technical field of image processing and pattern recognition, and specifically relates to a method for joint detection of human faces and key points of human faces based on transfer learning, which can be applied to many fields such as video monitoring, identity recognition, and human-computer interaction. Background technique [0002] Face detection is a technology that automatically searches for the position and size of a face in any image. Face key point detection is a technology that automatically searches for defined face feature points (such as pupils, nose, corners of mouth, etc.) in any image. ) position technology. Face detection and face key point detection play an important role in computer vision and pattern recognition applications, such as video surveillance and access control systems. For face recognition, face detection and face key point detection are two essential preprocessing steps. [0003] At present,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V40/161G06V40/172G06N3/045G06F18/22G06F18/214
Inventor 杨万扣葛涌涛郑文明
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products