Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Human face pose estimation method and system based on knowledge distillation

A face pose and knowledge technology, applied in the field of face image recognition, can solve the problems of high computing resource usage, need to improve the reasoning speed, and affect the effect of pose evaluation

Active Publication Date: 2021-05-18
南京烽火星空通信发展有限公司
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the large number of model parameters, in the inference stage, more computing resources are occupied, and the inference speed needs to be improved.
[0008] 2) The shallow network model predicts a large error in the attitude angle
Using some relatively simple feature extraction networks will affect the attitude evaluation effect and increase the angle error
[0010] 3) There is a large error in the pose estimation of images with large angle poses, blur and masks
[0011] Most of the training data of face pose use 300W or 300W-LP public data sets, and the pose estimation error for large-angle and blurred images is relatively large, and in the current application scenario, the robustness of face pose estimation results with masks is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human face pose estimation method and system based on knowledge distillation
  • Human face pose estimation method and system based on knowledge distillation
  • Human face pose estimation method and system based on knowledge distillation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The specific implementation manners of the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0055] The present invention designs a face pose estimation method based on knowledge distillation, such as figure 1 As shown, it is used to realize the estimation of the image face pose by the target classification network. For the last fully connected layer in the target classification network, it is replaced by three branches corresponding to the yaw angle direction yaw, the pitch angle direction pitch, and the roll angle direction roll Fully connected layer, the input end of each branch fully connected layer is connected to the output end of the last level feature extraction module in the target classification network, and each branch fully connected layer is respectively connected to a branch classification layer to construct a student classification network, so that the three Independent loss calculations are perfo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a human face pose estimation method and system based on knowledge distillation, which can compress a human face pose estimation model by applying a feature distillation method on the premise of ensuring the accuracy, the model parameter quantity after feature distillation is less, the reasoning speed of the human face pose is higher, the resource consumption is reduced, The method solves the problems of high resource consumption and low accuracy of a shallow network when a deep network structure is applied to face pose estimation, improves the pose estimation accuracy of a large-angle, fuzzy and mask-wearing face image according to the current application scene demand, improves the robustness of the model, improves the face pose angle prediction effect of the model, in practical application, a face pose angle prediction result in a complex scene is more accurate, and a prediction effect exceeding a ResNet50 network structure is realized by using a ResNet18 basic network.

Description

technical field [0001] The invention relates to a face pose estimation method based on knowledge distillation, which belongs to the technical field of face image recognition. Background technique [0002] In face alignment, face tracking, face recognition and other research work, face pose angle has an important impact, and pose estimation is an essential part of many face analysis tasks. Face pose estimation refers to the calculation of the specific direction of the face or head in three-dimensional space. Euler angles (Yaw, Pitch, Roll) are a commonly used face pose representation. [0003] At present, the face pose estimation method is mainly divided into two types: one is obtained by calculating the corresponding relationship between the key points of the face and the image to the three-dimensional coordinates, the pose result depends on whether the key point detection is accurate, and depends on the standard head model and camera The parameter matrix; the other is to r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/172G06V40/168G06N3/045
Inventor 李华蓉蔡娜娜郑鹏李峰岳王康
Owner 南京烽火星空通信发展有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products