Multi-modal emotion recognition method and system fusing voice and micro-expressions

An emotion recognition and micro-expression technology, applied in the field of emotion recognition, can solve the problems of low accuracy and large error of emotion recognition results, and achieve the effects of ensuring semantic integrity, reducing errors, and expanding comprehensiveness.
CN112307975APending Publication Date: 2021-02-02JIANGXI UNIV OF SCI & TECH
0 Cites 4 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
JIANGXI UNIV OF SCI & TECH
Publication Date
2021-02-02

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a multi-modal emotion recognition method and system fusing voice and micro-expressions, and relates to the technical field of situation recognition. The method comprises the steps of: establishing a voice emotion database and an emotion association function; acquiring voice information and face image information of the same target object at the same time, and extracting emotion representation vocabularies and micro-expression data; obtaining an emotion correlation function and an emotion fluctuation value corresponding to the micro-expression according to a matching result; establishing an emotion recognition network, and decomposing step by step to obtain a plurality of emotion recognition lines; obtaining a corresponding emotion fluctuation value, and establishingan emotion recognition curve; and selecting a qualified emotion recognition line according to a preset fluctuation degree after the emotion fluctuation degree is calculated. According to the invention, the authenticity of the real-time emotion of the target object represented by the voice information and the face image information is enhanced, the probability that the same situation reflects different situations is reduced, the accuracy of the emotion recognition result is improved, and the error of the emotion recognition result is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of emotion recognition, more specifically, it relates to a multi-modal emotion recognition method and system that integrates speech and micro-expressions. Background technique

[0002] Emotion recognition is an emerging research field interdisciplinary in computer science, cognitive science, psychology, brain science, neuroscience, etc. Its research purpose is to let computers learn to understand human emotional expressions, and ultimately enable them to recognize, The ability to understand emotions. Therefore, as a very challenging interdisciplinary subject, emotion recognition has become a research hotspot in the fields of pattern recognition, computer vision, big data mining and artificial intelligence at home and abroad, and has important research value and application prospects.

[0003] At present, there are two ways for emotion recognition, one is to detect physiological signals such as breathing, he...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More