Facial expression recognition method and device based on facial action unit

A facial action and facial expression technology, applied in the field of computer vision, can solve problems such as the inability to effectively solve the problem of micro-expression recognition, and achieve the effect of improving the performance of facial expression recognition and reducing system consumption.

Pending Publication Date: 2020-09-04
北京市西城区培智中心学校 +1
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For this reason, the embodiment of the present invention provides a facial expression recognition method based on facial action units to solve the problem that the machine learning method in the prior art cannot effectively solve the micro-expression recognition problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression recognition method and device based on facial action unit
  • Facial expression recognition method and device based on facial action unit
  • Facial expression recognition method and device based on facial action unit

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] The implementation mode of the present invention is illustrated by specific specific examples below, and those who are familiar with this technology can easily understand other advantages and effects of the present invention from the contents disclosed in this description. Obviously, the described embodiments are a part of the present invention. , but not all examples. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0027] Embodiments of the method for recognizing facial expressions based on facial action units according to the present invention will be described in detail below. like figure 1 As shown, it is a flow chart of a facial expression recognition method based on a facial action unit provided by an embodiment of the present invention, and the specific implementation process includes the following s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a facial expression recognition method and device based on facial action units, and the method comprises the steps: carrying out the preprocessing of collected image data containing a human face region through employing a human face key point detection technology, and enabling the human face region to be subdivided into a plurality of facial action unit triggering regions; utilizing a preset three-dimensional convolutional neural network recognition model to recognize the facial action unit to obtain features of the facial action unit; performing feature fusion on the obtained facial global features and the features of the facial action unit to obtain facial expression fusion features; and inputting the facial expression fusion features into a preset Gaussian process classifier, recognizing the facial expression of the human face by using the Gaussian process classifier, and outputting a facial expression recognition result. By the adoption ofthe method, expression recognition can be conducted on the basis of the facial action unit, recognition of tiny expressions is better facilitated, and facial expression recognition performance and robustness are improved.

Description

technical field [0001] Embodiments of the present invention relate to the field of computer vision, and in particular to a facial expression recognition method and device based on facial action units. In addition, it also relates to an electronic device and a storage medium. Background technique [0002] In recent years, with the rapid development of economy and society, people's demand for intelligent life is increasing day by day. With the continuous development and maturity of artificial intelligence technology, high-quality human-computer interaction experience is a necessary condition for improving and perfecting the quality of intelligent life. Therefore, the emotional analysis of users in the process of human-computer interaction is a key link. Since facial expressions play a very important role in human emotional expression, rich emotional information can be obtained by analyzing facial expressions. In addition, the acquisition of facial expressions only needs to b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/169G06V40/176G06V40/171G06V40/20G06V40/172G06F18/253G06F18/24
Inventor 姚辉芦燕云陈晓华孙广宇李欣才智章莉
Owner 北京市西城区培智中心学校
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products