Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Face expression identification method and device

A facial expression recognition and expression recognition technology, which is applied in the field of image recognition, can solve the problems of accurate recognition of difficult neutral expressions and poor facial expression recognition performance, and achieves the effect of improving prediction accuracy and robustness and improving recognition performance.

Inactive Publication Date: 2017-07-25
SENSETIME GRP LTD
View PDF5 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the above-mentioned facial expression recognition method, the deep convolutional neural network is obtained through single-frame image training, and since the facial expression is closely related to the scene context and is very related to the neutral expression of the object, the above-mentioned facial expression The recognition method is difficult to accurately identify neutral expressions, and the recognition performance of facial expressions is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face expression identification method and device
  • Face expression identification method and device
  • Face expression identification method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] An example of the present invention provides a method for recognizing facial expressions. Such as Figure 1-a As shown, the facial expression recognition method in the embodiment of the present invention comprises:

[0027] Step 101, acquiring a face image sequence to be recognized;

[0028] Wherein, the above sequence of human face images includes a single frame or more than two frames of human face images. That is, the facial expression recognition method in the embodiment of the present invention can recognize continuous multi-frame facial images (such as video), and is also compatible with the recognition of single-frame facial images.

[0029] In step 101, the face image sequence to be recognized can be obtained in real time through the camera, or the face image sequence to be recognized can be obtained by receiving the face image sequence from an external device, or it can also be based on user The face image sequence to be recognized is obtained by selecting fr...

Embodiment 2

[0062] Examples of the present invention provide a human facial expression recognition device, such as figure 2 As shown, the facial expression recognition device 200 in the embodiment of the present invention includes:

[0063] An image acquisition unit 201, configured to acquire a sequence of human face images to be recognized, the sequence of human face images comprising a single frame or more than two frames of human face images;

[0064] An image preprocessing unit 202, configured to preprocess each frame of human face images in the sequence of human face images;

[0065] Recognition processing unit 203, for inputting each preprocessed human face image into the trained training model for expression recognition, and obtaining the expression recognition result of the human face image sequence;

[0066] Wherein, the input end to the output end of the training model is successively constructed by a convolutional neural network model, a long-short-term memory recurrent neura...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a face expression identification method and device. The method comprises steps that a to-be-identified face image sequence is acquired, and the face image sequence comprises one or more than two face images; each face image of the face image sequence is pre-processed; the pre-processed face images are inputted to a trained training model to carry out expression identification to acquire expression identification results of the face image sequence; a convolutional neural network model, a long-time short-time memory cycle neural network model, a first pooling layer and a logic regression model are sequentially constructed from an input end to an output end of the training model, and the training model is acquired through training a continuous-image set marked with expression categories. The method is advantaged in that face expression identification performance can be effectively improved.

Description

technical field [0001] The invention relates to the technical field of image recognition, in particular to a facial expression recognition method and a human facial expression recognition device. Background technique [0002] Facial expression recognition technology refers to assigning an expression category to a given face image, including: anger, disgust, happiness, sadness, fear, surprise, etc. At present, facial expression recognition technology has gradually shown broad application prospects in the fields of human-computer interaction, clinical diagnosis, distance education and investigation and interrogation, and is a popular research direction of computer vision and artificial intelligence. [0003] At present, there is a facial expression recognition method based on a deep convolutional neural network. After the face image is detected and calibrated, the calibrated human face image is input into a trained deep convolutional neural network. Expression recognition. I...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/08
CPCG06N3/084G06V40/174G06F18/214
Inventor 金啸胡晨晨旷章辉张伟
Owner SENSETIME GRP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products