Face analysis method and system combining multi-task and multi-scale convolution neural network

A convolutional neural network and analysis method technology, applied in the field of face analysis that integrates multi-task and multi-scale convolutional neural networks, can solve the problems of obtaining facial key points, head posture, etc., and achieve the effect of improving prediction accuracy

Inactive Publication Date: 2019-03-22
CHINA UNIV OF GEOSCIENCES (WUHAN)
View PDF6 Cites 38 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the recent research based on deep convolutional neural network (CNN) has achieved remarkable results, and has been widely used in face recognition, face tracking, face detection and other fields, but for face detection tasks, It is still difficult to obtain facial keypoints, head pose, gender and expression information from face images containing extreme poses, lighting and resolution changes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face analysis method and system combining multi-task and multi-scale convolution neural network
  • Face analysis method and system combining multi-task and multi-scale convolution neural network
  • Face analysis method and system combining multi-task and multi-scale convolution neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] In order to have a clearer understanding of the technical features, purposes and effects of the present invention, the specific implementation manners of the present invention will now be described in detail with reference to the accompanying drawings.

[0050] refer to Figure 1-Figure 3 In this embodiment, the face analysis method of integrating multi-task joint multi-scale convolutional neural network specifically includes the following steps.

[0051] (1) Multi-scale face attention area extraction steps:

[0052] For a picture to be detected with a size of N×N, the attention detection network is used to extract three scales of face interest regions, the sizes are 227×227, 147×147, 59×59, and they are used as The input of the three channels of the multi-scale CNN; where N represents the pixel size

[0053] (2) Fusion multi-scale learning steps, constructing the fusion multi-task Triple network learning model of three channels, including feature extraction sub-steps...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face analysis method and a face analysis system integrating a multi-task combined multi-scale convolution neural network, Firstly, the key region search algorithm is used toextract K face regions of interest with different scales from a picture of N *N size, which is used as the input of three channels of multi-scale CNN. Then, CNN is used to extract the features of theK regions of interest to obtain the features of faces with different scales, and the extracted features of faces with different scales are fused in a cascade manner to obtain the fused feature expression; Then, the loss functions of a plurality of tasks are fused to obtain a joint loss function, and the feature expression is used as a learning input to obtain an optimal solution of the joint lossfunction, so as to obtain a processing result of the plurality of tasks. The invention utilizes the correlation between tasks to promote each other, and improves the prediction accuracy rate of a single task.

Description

technical field [0001] The present invention relates to the field of human face attributes, and more specifically, relates to a face analysis method and system that integrates multi-task and multi-scale convolutional neural networks. Background technique [0002] In recent years, with the development of the Internet and the achievements of artificial intelligence-related technologies in practical applications, the field of artificial intelligence has attracted the attention of more and more scientific researchers, and the application range of artificial intelligence technology has become wider and wider. In the field of computer vision, face detection and analysis has always been a hot research direction. Although the recent research based on deep convolutional neural network (CNN) has achieved remarkable results, and has been widely used in face recognition, face tracking, face detection and other fields, but for face detection tasks, It is still difficult to obtain facial...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/175G06V40/168G06V40/172G06F18/253
Inventor 刘袁缘周顺平张香兰方芳郭明强姚尧彭济耀
Owner CHINA UNIV OF GEOSCIENCES (WUHAN)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products