Facial expression recognition method based on depth measurement fusion network

A technology that integrates networks and facial expressions. It is applied in character and pattern recognition, facial features acquisition/recognition, and computer components. Stickiness and distinguishability, the effect of improving the accuracy rate

Active Publication Date: 2019-10-25
ZHEJIANG GONGSHANG UNIVERSITY
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the difficulty of facial expression classification based on image features in the prior art and the difficult convergence of metric learning, which will lead to insufficient learning ability of the network and low recognition accuracy, the present invention provides a method that can improve the accuracy of facial expression recognition. Efficient facial expression recognition method based on deep metric fusion network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression recognition method based on depth measurement fusion network
  • Facial expression recognition method based on depth measurement fusion network
  • Facial expression recognition method based on depth measurement fusion network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be further described below in conjunction with accompanying drawing and specific embodiment:

[0036] Such as figure 1 Shown embodiment is a kind of facial expression recognition method based on depth measurement fusion network, comprises the steps:

[0037] Step 100, input image preprocessing

[0038] Use facial key points to crop the facial area of ​​interest, and scale the cropped image to a size of 236*236; use offline and online data enhancement methods to perform image enhancement on the scaled image: offline enhancement is coming The input image is correspondingly rotated {-10°, -5°, 0, 5°, 10°} to obtain the enhanced image data; online enhancement means randomly changing the image from four directions (center, upper left, lower left, upper right) during network training , lower right) to crop out a 224*224 size image, and randomly flip it horizontally as the input image of the depth metric fusion network;

[0039] Step 200, constru...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a facial expression recognition method based on a depth measurement fusion network, and the method comprises the following steps: firstly carrying out the preprocessing of an input image; secondly, constructing a depth measurement fusion network combined with various expression feature representations, and finally, training the depth measurement fusion network by utilizingthe training sample; and during testing, inputting a to-be-detected facial expression image into the trained depth measurement fusion network to obtain classification categories of expressions. The method has the following beneficial effects that different expression distributions are learned by using multiple pieces of threshold information, so that the learned features are more robust and distinguishable; a symmetric triple loss function is used, the problems of incomplete judgment and anchor point selection sensitivity can be avoided, convergence of the deep metric fusion network is accelerated, and the learning ability is improved; the accuracy of facial expression recognition can be improved.

Description

technical field [0001] The invention relates to the technical field of facial expression recognition, in particular to a facial expression recognition method based on a deep metric fusion network that can improve the accuracy of facial expression recognition. Background technique [0002] Facial expression is one of the most natural and common signals for humans to convey emotional states. Expression recognition has broad application prospects in business, security, medicine and other fields. The ability to quickly and accurately recognize facial expressions is of great significance to its research and application. Traditional machine learning methods need to manually extract features and the accuracy is difficult to guarantee. In recent years, convolutional neural networks have been widely used in expression recognition due to their good self-learning and generalization capabilities, but expression recognition is still a challenge due to changes in pose, lighting, and indiv...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/174G06V40/168G06V40/172G06F18/217G06F18/253
Inventor 杨文武陈拓邢帅
Owner ZHEJIANG GONGSHANG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products