Difference depth feature-based facial expression recognition method and system

A facial expression recognition and deep feature technology, applied in the field of image processing and pattern recognition, can solve the problems of low robustness, noise interference, and low precision of facial expression recognition, and achieve improved robustness, strong discrimination ability, and improved automation Effect

Active Publication Date: 2018-03-16
HUAZHONG NORMAL UNIV
View PDF2 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, a lot of research has been carried out in this field, but there are still problems such as low robustness, low precision, and susceptibility to noise interference in expression recognition.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Difference depth feature-based facial expression recognition method and system
  • Difference depth feature-based facial expression recognition method and system
  • Difference depth feature-based facial expression recognition method and system

Examples

Experimental program
Comparison scheme
Effect test

example

[0065] The sample expression library was created by Binghamton University, including 100 adults aged 18-70, each with 6 prototype expressions: anger, disgust, fear, happiness, sadness, surprise, a total of 2,500 facial expression models, of which 56% were women and 44% were men. The present invention selects 64 people from 100 people, and each person has 6 expression sequences, and a total of 384 expression sequences are used as input. The specific implementation steps are as follows:

[0066] 1. Preprocessing the facial expression images

[0067] (1.1) Use the Haar-like feature and adaboost learning algorithm proposed by Viola and Jones to detect the face area of ​​each expression image;

[0068] (1.2) Perform affine transformation on the face image extracted in step (1.1) to realize image scale normalization and face alignment. After transformation, the size of all images is normalized to 224×224, and the center coordinates of the eyes in all images remain consistent. The...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a difference depth feature-based facial expression recognition method and system and belongs to the pattern recognition technical field. The method includes the following stepsthat: face depth features are extracted from a sample face region frame sequence, and neutral expression frames and peak expression frames are extracted from the sample face region frame sequence according to the face depth features; and the face depth features of the neutral expression frames are subtracted from the face depth features of the peak expression frames of the sample image frame sequence, so that difference depth features can be obtained; and the difference depth features of the sample face region frame sequence and corresponding facial expressions are adopted as training input, so that a facial expression classifier can be obtained through training, and the facial expression classifier is adopted to achieve facial expression classification. According to the difference depth feature-based facial expression recognition method and system of the invention, the concept of difference is introduced into the depth features, and the difference depth features are used to representfacial expressions, and therefore, facial expression information can be preserved as much as possible, and at the same time, individual differences and environmental noises can be eliminated; and thedistinguishing capability of used features for the facial expressions is strong, so that the robustness of facial expression recognition can be improved.

Description

technical field [0001] The invention belongs to the technical field of image processing and pattern recognition, and in particular relates to a facial expression recognition method based on differential depth features. Background technique [0002] Facial expression recognition is a comprehensive subject involving pattern recognition, image processing, artificial intelligence and other disciplines. The so-called facial expression recognition refers to the process of allowing the computer to extract features from a given expression image, and combine the prior knowledge of humans to carry out learning, reasoning, and judgment, and then understand the process of human emotions. Facial expression recognition has application value in many fields, including robotics, human-computer interaction, intelligent transportation, intelligent education, animation production, etc., and is a current research hotspot. [0003] Deep learning is a new field in machine learning research. It or...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/176G06V40/161G06F18/23213
Inventor 陈靓影徐如意徐灿刘乐元张坤
Owner HUAZHONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products