Multi-modal emotion identification system and method

A multi-modal, emotion recognition technology, applied in character and pattern recognition, speech recognition, acquisition/recognition of facial features, etc., can solve problems such as less information, difficulty in realizing human emotion recognition, single emotion recognition method, etc., to achieve accurate recognition effect

Active Publication Date: 2017-03-15
EMOTIBOT TECH LTD
View PDF12 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, emotion recognition machines usually identify human emotions by using one of text recognition technology, speech recognition technology or visual image recognition technology. This kind of emotion recognition method is single, and the amount of information used for emotion recognition is small. , it is difficult to realize human emotion recognition in complex situations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-modal emotion identification system and method
  • Multi-modal emotion identification system and method
  • Multi-modal emotion identification system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0022] combine figure 1 , the multimodal emotion recognition system provided in this embodiment includes: a voice receiver 1, a first emotion recognition subsystem 3, a second emotion recognition subsystem 4, a visual image receiver 2, a third emotion recognition subsystem 5, Emotional output device 6; Voice receiver 1, is used for receiving the voice signal that target object sends; Visual image receiver 2, is used for receiving the visual image data about target object; The first emotion identification subsystem 3, is used for according to voice signal Obtain the first emotion recognition result; the second emotion recognition subsystem 4 is used to obtain the second emotion recognition result according to the voice signal; the third emotion recognition subsystem 5 is used to obtain the third emotion recognition result according to the visual image data; emotion output A device 6 is configured to determine the emotional state of the target object according to the first emoti...

Embodiment 2

[0033] combine image 3 , an embodiment of the present invention provides a multi-modal emotion recognition method, including:

[0034] Step S1: the voice receiver 1 receives the voice signal sent by the target object;

[0035] Step S2: the visual image receiver 2 receives visual image data about the target object;

[0036] Step S3: the first emotion recognition subsystem 3 obtains the first emotion recognition result according to the voice signal;

[0037] Step S4: The second emotion recognition subsystem 4 obtains a second emotion recognition result according to the voice signal;

[0038] Step S5: The third emotion recognition subsystem 5 acquires a third emotion recognition result according to the visual image data;

[0039] Step S6: The emotion output unit 6 determines the emotional state of the target object according to the first emotion recognition result, the second emotion recognition result and the third emotion recognition result.

[0040] Preferably, as Figur...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a multi-modal emotion identification system and method. The system comprises a voice receiver, a first emotion identification subsystem, a second emotion identification subsystem, a vision image receiver, a third emotion identification subsystem and an emotion output device, wherein the voice receiver is used for receiving voice signals emitted by a target object; the vision image receiver is used for receiving vision image data about the target object; the first emotion identification subsystem is used for obtaining a first emotion identification result according to the voice signals; the second emotion identification subsystem is used for obtaining a second emotion identification result according to the voice signals; the third emotion identification subsystem is used for obtaining a third emotion identification result according to the vision image data; and the emotion output device is used for determining an emission state of the target object according to the emotion identification result, the second emotion identification result and the third emotion identification result.

Description

technical field [0001] The invention relates to computer processing technology, in particular to a multi-modal emotion recognition system and method. Background technique [0002] At present, emotion recognition machines usually identify human emotions by using one of text recognition technology, speech recognition technology or visual image recognition technology. This kind of emotion recognition method is single, and the amount of information used for emotion recognition is small. , it is difficult to realize human emotion recognition in complex situations. Contents of the invention [0003] The technical problem to be solved by the present invention is to provide a multi-modal emotion recognition system and method, which integrates text recognition technology, speech recognition technology and visual image recognition technology, and simultaneously conducts human emotion recognition from multiple channels, so that the emotion recognition machine can Accurately identify...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06F17/27G10L15/02G10L15/18G10L15/26
CPCG10L15/02G10L15/1807G10L15/1822G10L15/26G06F40/211G06F40/284G06V40/174G06V40/171G06V40/172G06V40/161G06V40/20G06F18/24
Inventor 简仁贤杨闵淳林志豪孙廷伟
Owner EMOTIBOT TECH LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap