Check patentability & draft patents in minutes with Patsnap Eureka AI!

Emotion recognition method and device based on multi-modal signal, equipment and storage medium

An emotion recognition and multi-modal technology, applied in speech recognition, neural learning methods, biological neural network models, etc., can solve the problem of low accuracy of emotion recognition and achieve the effect of low accuracy

Pending Publication Date: 2021-09-21
PING AN TECH (SHENZHEN) CO LTD
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides an emotion recognition method, device and computer-readable storage medium based on multimodal signals, the main purpose of which is to solve the problem of low accuracy in emotion recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emotion recognition method and device based on multi-modal signal, equipment and storage medium
  • Emotion recognition method and device based on multi-modal signal, equipment and storage medium
  • Emotion recognition method and device based on multi-modal signal, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0059] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0060]An embodiment of the present application provides an emotion recognition method based on multimodal signals. The executor of the multimodal signal-based emotion recognition method includes, but is not limited to, at least one of electronic devices such as a server and a terminal that can be configured to execute the method provided by the embodiment of the present application. In other words, the multi-modal signal-based emotion recognition method can be executed by software or hardware installed on a terminal device or a server device, and the software can be a block chain platform. The server includes, but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, and the like.

[0061] refer to figure 1 As shown, it is a schematic flowchart of an emotion recognition meth...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a speech semantic technology, and discloses an emotion recognition method based on a multi-mode signal, which comprises the following steps: acquiring information of three modes of speech, text and footstep sound of a user, respectively performing feature extraction on the speech, the text and the footstep sound, predicting emotional states of the user in the three modes according to the extracted features, and combining the emotional states of the user in the three modes to carry out fusion decision so as to finally determine the emotional state of the user. In addition, the invention also relates to a block chain technology, and the voice, text and footstep information of the user can be stored in nodes of a block chain. The invention further provides an emotion recognition device based on the multi-modal signal, electronic equipment and a storage medium. The accuracy of emotion recognition can be improved.

Description

technical field [0001] The present invention relates to the technical field of speech semantics, in particular to an emotion recognition method, device, electronic equipment and computer-readable storage medium based on multimodal signals. Background technique [0002] In recent years, with the continuous development of artificial intelligence technology, researchers pay more and more attention to high-precision human-computer interaction. It not only requires the computer to understand the user's emotions and intentions, but also needs to give different tasks to different users, different environments, and different tasks. Feedback and support, which requires computers to understand the user's emotions and express them effectively. [0003] At this stage, emotion recognition is mostly based on facial expressions, voice, body and EEG. Among them, the emotion recognition on sound is mainly language-like sound, that is, human speech, which can be divided into voice and text. A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F40/289G06F40/242G06F40/216G06N3/04G06N3/08G10L15/26G10L25/24G10L25/27G10L25/63
CPCG06F40/289G06F40/216G06F40/242G06N3/08G10L25/63G10L25/27G10L25/24G10L15/26G06N3/048G06N3/044G06N3/045Y02D10/00
Inventor 彭俊清王健宗刘源
Owner PING AN TECH (SHENZHEN) CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com