Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and device for recognizing facial micro-expressions

A recognition method and micro-expression technology, applied in character and pattern recognition, instruments, computing, etc., can solve unexplored problems

Active Publication Date: 2020-12-01
UNIV OF SCI & TECH BEIJING
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Robust methods for mapping AUs to emotions remain largely unexplored in the state of the art, and there are few deterministic association rule-based techniques for mapping AUs to emotion categories to recognize facial expressions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for recognizing facial micro-expressions
  • A method and device for recognizing facial micro-expressions
  • A method and device for recognizing facial micro-expressions

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] Such as figure 1 As shown, the facial micro-expression recognition method provided by the embodiment of the present invention includes:

[0060] S101. Determine the correlation between AUs in the expression database and the correlation between AUs and expressions, where AU represents a facial action unit;

[0061] S102. Obtain an AU template sequence for each expression according to the determined correlation between the AU and the expression in the expression database;

[0062] S103, acquiring the AU sequence of the test sample;

[0063] S104, according to the determined correlation between AUs in the expression database, use the adaptive public subsequence matching method to calculate the similarity between the AU sequence of the test sample and the AU template sequence of each expression, and obtain the AU corresponding to the maximum similarity The expression type to which the template sequence belongs is used as the expression type of the test sample.

[0064] T...

Embodiment 2

[0120] The present invention also provides a specific embodiment of a human face micro-expression recognition device, because the human face micro-expression recognition device provided by the present invention corresponds to the specific embodiment of the aforementioned human face micro-expression recognition method, the human face micro-expression recognition device The purpose of the present invention can be realized by executing the process steps in the specific implementation of the above-mentioned method, so the explanations in the specific implementation of the above-mentioned human facial micro-expression recognition method are also applicable to the specific implementation of the human facial micro-expression recognition device provided by the present invention. Embodiments will not be repeated in the following specific embodiments of the present invention.

[0121] Such as Figure 4 As shown, the embodiment of the present invention also provides a human face micro-ex...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a face micro-expression recognition method and a face micro-expression recognition device, which can improve the recognition precision of expressions on the basis of reducing the calculation amount. The method comprises the steps of determining the relevance between AUs in an expression database and the relevance between the AUs and expressions, and the AUs represent facialaction units; obtaining an AU template sequence of each expression according to the determined relevance between the AU and the expression in the expression database; obtaining an AU sequence of the test sample; and according to the correlation between the AUs in the expression database, calculating the similarity between the AU sequence of the test sample and the AU template sequence of each expression by using a self-adaptive common subsequence matching method, and obtaining the expression type to which the AU template sequence corresponding to the maximum similarity belongs as the expression type of the test sample. The invention relates to the field of image processing and pattern recognition.

Description

technical field [0001] The invention relates to the field of image processing and pattern recognition, in particular to a recognition method and recognition device for facial micro-expressions. Background technique [0002] With the increasing demand for automatic emotion recognition, the study of human face as an important expression of expression has attracted more and more attention. Psychologists Ekman and Friesen developed the Facial Action Coding System (FACS), which describes facial states as a combination of facial action units (AU), which are movements of different muscles in the face. Automatic detection of AU is of great help to facial expression recognition, and has a wide range of applications in human-computer interaction, online learning, market research, multimedia, and mental health of patients with depression. [0003] It can be known from FACS that there are 43 muscles in the human face, and these muscles form more than 10,000 facial states, at least 3,00...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00
Inventor 支瑞聪李婷婷刘梦祎
Owner UNIV OF SCI & TECH BEIJING