Expression recognition method, device, terminal device and storage medium

A technology of expression recognition and emotion recognition, applied in the information field, can solve the problem of low accuracy of recognition results, achieve the effect of improving accuracy and robustness, and improving accuracy

Active Publication Date: 2019-03-26
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF8 Cites 48 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the embodiment of the present invention provides a method, device, terminal device, and storage medium for facial expression recognition to solve the problem in the prior art that only relying on static image features for facial expression recognition results in low accuracy of recognition results

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Expression recognition method, device, terminal device and storage medium
  • Expression recognition method, device, terminal device and storage medium
  • Expression recognition method, device, terminal device and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

[0033] The technical solutions of the present invention are illustrated below through specific examples.

[0034] refer to figure 1 , which shows a schematic flow chart of the steps of an expression recognition device and method according to an embodiment of the present invention, which may specifically include the following steps:

[0035] S101. Obtain video information to be recognized includi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention is applicable to the field of information technology, and provides a method, a device, a terminal device and a storage medium for expression recognition. The method comprises the following steps: obtaining video information to be recognized including a face image; Extracting a plurality of video sequences and audio information from the video information to be identified; Recognizing the image expression recognition probability and the dynamic expression recognition probability corresponding to the multi-frame video sequences; And identifying an audio emotion recognition probability corresponding to the audio information; Based on the image expression recognition probability, genertaing the dynamic expression recognition probability and the audio emotion recognition probability, the expression recognition result corresponding to the face image in the video information to be recognized. This embodiment takes audio information as important complementary information and reduces the negative influence of inconspicuous expressions and poor quality video frames in the video sequence on recognition, pays attention to the prominent expressions in the video frames, and improves the accuracy and robustness of video expression recognition.

Description

technical field [0001] The invention belongs to the field of information technology, and in particular relates to an expression recognition method, an expression recognition device, a terminal device and a computer-readable storage medium. Background technique [0002] Expressions are one of the most powerful, natural and common signals used by humans to express emotions and intentions. Recognition of human expressions has increasingly become the focus of research in various fields, and has been used in social robots, medical care, driving, etc. There are a large number of applications in the field of employee status detection. [0003] For example, in social robots, the robot can accurately understand human intentions by recognizing human expressions and make correct decisions; in driver status detection, after the driver's anger is detected by the algorithm, the driver can be ordered to tighten the safety It can improve the responsiveness of the car brakes, or send an ala...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V40/174G06V40/172G06V20/41
Inventor 孟锝斌乔宇彭小江王锴曾小星张凯鹏
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap