Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Facial expression recognition method based on facial motion unit combination features

A facial expression recognition and feature combination technology, applied in the field of facial expression recognition, can solve problems such as poor recognition rate, and achieve the effect of improving the recognition rate

Inactive Publication Date: 2013-04-24
NORTHWESTERN POLYTECHNICAL UNIV
View PDF3 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to overcome the shortcomings of the existing facial expression recognition method based on facial action units to the poor recognition rate of a single facial action unit, the present invention provides a facial expression recognition method based on the combined features of facial action units

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression recognition method based on facial motion unit combination features
  • Facial expression recognition method based on facial motion unit combination features
  • Facial expression recognition method based on facial motion unit combination features

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] refer to Figure 1-3 . The concrete steps of the inventive method are as follows:

[0023] (a) The establishment of a large-scale expression database.

[0024] Using literature 2 "X.Wang, X Feng, and J Peng, A Novel Facial Expression DatabaseConstruction Method based on Web Images, in Proc.Of the Third Intl.Conf.on InternetMultimedia Computing and Service(ICIMCS'11)(2011) 124 -127” method, for each expression, download 2000 pictures from the Internet, and through interactive filtering, get 500 pictures of each expression to form a large-scale facial expression database, the database has a total of 500 × 6 = 3000 expression pictures .

[0025] For each expression picture in the database, manually locate the position of the eyes, according to the geometric ratio of each part of the face (such as figure 2 shown) for face detection and normalization.

[0026] Select multiple people to perform manual AU annotation on each emoticon picture, and take the annotation resul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a facial expression recognition method based on facial motion unit combination features. The facial expression recognition method based on the facial motion unit combination features is used for solving the technical problem of low recognition rate of a single facial motion unit with an existing facial expression recognition method based on facial motion units. The technical scheme includes that the facial expression recognition method based on the facial motion unit combination features comprises the steps of building a large-scale facial expression data base, carrying out clustering of each category of facial expressions and corresponding training samples by using the affinity propagation (AP) clustering algorithm, judging arbitrary unit (AU) combinations in each sub-category, determining the number of the sub-categories under the same facial expression by combining main AU combinations, generating the number of the categories of the training sample by combining the sub-categories of all facial expressions, and carrying out classification training by using the support vector machine (SVM) method. According to the facial expression recognition method based on the facial motion unit combination features, the recognition rate of the single facial motion unit is improved, namely that average recognition rate of a single AU unit is improved from 87.5% in prior are to 90.1% and by 2.6%.

Description

technical field [0001] The invention relates to a facial expression recognition method, in particular to a facial expression recognition method based on facial action unit combination features. Background technique [0002] Facial expression recognition is an important research direction in the fields of human-computer interaction, machine learning, intelligent control and image processing, and has become a hot research topic at home and abroad. The expression recognition method based on facial activity units is based on the facial activity coding system in psychology, and the expression recognition is performed by establishing the relationship between the visual features of the face and the facial activity units, as well as the relationship between the facial activity units and the six basic expressions. The introduction of facial activity units reduces the gap between the complex visual features of human faces and the six basic expressions. [0003] Document 1 "Velusamy S...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62
Inventor 冯晓毅彭进业夏召强范建平赖阳明王保平谢红梅李会方何贵青蒋晓月吴俊王珺
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products