Facial expression recognition method and device based on facial action unit

Abstract

The embodiment of the invention discloses a facial expression recognition method and device based on facial action units, and the method comprises the steps: carrying out the preprocessing of collected image data containing a human face region through employing a human face key point detection technology, and enabling the human face region to be subdivided into a plurality of facial action unit triggering regions; utilizing a preset three-dimensional convolutional neural network recognition model to recognize the facial action unit to obtain features of the facial action unit; performing feature fusion on the obtained facial global features and the features of the facial action unit to obtain facial expression fusion features; and inputting the facial expression fusion features into a preset Gaussian process classifier, recognizing the facial expression of the human face by using the Gaussian process classifier, and outputting a facial expression recognition result. By the adoption ofthe method, expression recognition can be conducted on the basis of the facial action unit, recognition of tiny expressions is better facilitated, and facial expression recognition performance and robustness are improved.

Description

technical field [0001] Embodiments of the present invention relate to the field of computer vision, and in particular to a facial expression recognition method and device based on facial action units. In addition, it also relates to an electronic device and a storage medium. Background technique [0002] In recent years, with the rapid development of economy and society, people's demand for intelligent life is increasing day by day. With the continuous development and maturity of artificial intelligence technology, high-quality human-computer interaction experience is a necessary condition for improving and perfecting the quality of intelligent life. Therefore, the emotional analysis of users in the process of human-computer interaction is a key link. Since facial expressions play a very important role in human emotional expression, rich emotional information can be obtained by analyzing facial expressions. In addition, the acquisition of facial expressions only needs to b...

AI Technical Summary

Problems solved by technology

[0004] For this reason, the embodiment of the present invention provides a facial expression recognition method based on facial action units to solve the problem that the machine learning method in the prior art cannot effectively solve the micro-expression recognition problem

Images