PCANet-CNN-based arbitrary attitude facial expression recognition method

A facial expression recognition and gesture technology, applied in the field of emotion recognition, can solve the problems of reducing model recognition rate and efficiency, insufficient information, etc., and achieve the effect of improving efficiency, recognition rate and accuracy.

Active Publication Date: 2016-03-30
JIANGSU UNIV
View PDF3 Cites 58 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First of all, this method only uses key points to learn the mapping relationship between frontal face images and side face images, and the information is i...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • PCANet-CNN-based arbitrary attitude facial expression recognition method
  • PCANet-CNN-based arbitrary attitude facial expression recognition method
  • PCANet-CNN-based arbitrary attitude facial expression recognition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention first preprocesses the original image, including face detection, image grayscale and image size normalization. Then, through the unsupervised learning method - principal component analysis network PCANet, the feature learning is performed on the preprocessed frontal face image to obtain the frontal face features. The learned front face feature will be used as the label of the supervised convolutional neural network CNN to update the weights and biases of the two-layer CNN. The reconstruction error function value between, and stop when the reconstruction error function value tends to converge, and obtain the final mapping relationship between the front face feature and the side face feature. Use this mapping relationship for any feature of the face image to be recognized to obtain a unified front face feature, and then input the support vector machine SVM for training and facial expression recognition.

[0036] The present invention will be further...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a PCANet-CNN-based arbitrary attitude facial expression recognition method. The method comprises the following steps: firstly pre-processing the original images to obtain gray level facial images with uniform size, wherein the gray level facial images comprise front facial images and side facial images; inputting the front face images into an unsupervised characteristic learning model PCANet and learning to obtain characteristics corresponding to the front facial images; inputting the side facial images into a supervised characteristic learning model CNN, and training by taking the front facial characteristics obtained through the unsupervised characteristic learning as labels so as to obtain a mapping relationship between the front facial characteristics and the side facial characteristics; and obtaining uniform front facial characteristics corresponding to the facial images at arbitrary attitudes through the mapping relationship, and finally sending the uniform front facial characteristics into SVM to train so as to obtain a uniform recognition model in allusion to arbitrary attitudes. According to the method provided by the invention, the problem of low model recognition rate caused by the condition of respectively modeling for each attitude in the traditional multi-attitude facial expression recognition and the factors such as attitude and the like is solved, and the correctness of the multi-attitude facial image expression recognition can be effectively improved.

Description

technical field [0001] The invention belongs to the field of emotion recognition, and in particular relates to a PCANet-CNN-based method and system for recognizing facial expressions in arbitrary poses Background technique [0002] Facial expression recognition is an important research direction in the fields of pattern recognition, human-computer interaction and computer vision, and has become a research hotspot at home and abroad. Generally speaking, the six most common basic human expressions are happiness, sadness, anger, surprise, disgust and fear. In recent years, with the continuous proposal of various features that are robust to poses, the development of multi-pose automatic facial expression recognition technology has been promoted. For example, the traditional face recognition model can only perform facial expression recognition based on pictures of frontal or near-frontal faces, but the recognition effect on facial expressions of side faces or faces with a certai...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/173G06V40/174G06F18/2411
Inventor 毛启容张飞飞于永斌詹永照许国朋屈兴
Owner JIANGSU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products