Speech Signal Analysis Subsystem Based on Multimodal Emotion Recognition System
A technology of emotion recognition and speech signal, applied in speech analysis, character and pattern recognition, speech recognition, etc., can solve the problems of unintegrated human expressions, spoken words, body, voice, intonation and physiological characteristics, etc., to improve emotion analysis , reduce costs, improve the effect of ease of use
Active Publication Date: 2020-10-02
南京云思创智信息科技有限公司
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, it does not integrate people's facial expressions, spoken words, body posture, voice intonation and physiological characteristics, etc.
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0060] The invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.
[0061] Because the production of any emotion is accompanied by certain changes in the body, such as facial expressions, muscle tension, and visceral activities. Using these signal changes to directly perform emotion recognition is the so-called basic recognition method, also known as a single-modal emotion recognition method. The current main methods include facial images, language, text, gestures and physiological signals. The present invention proposes to integrate, correspond and reason the understanding of emotions by computers in each of the following single modes to obtain a more complete and accurate emotion recognition method and system.
[0062] The emotion recognition system based on multimodal that present embodiment proposes, its system is made up of following several parts ( figure 1 It is a schematic diagram of a multimodal emo...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a speech signal analysis subsystem based on a multi-modal emotion recognition system, which includes a data acquisition device and an output device, and is characterized in that it also includes an emotion analysis software system, and the emotion analysis software system passes through the The data obtained by the data acquisition device is comprehensively analyzed and reasoned, and finally the result is output to the output device; the emotion analysis software system includes an emotion recognition subsystem based on voice signals. The present invention breaks through the five single-modal emotion recognition, innovatively uses the deep neural network to encode multiple single-modal information by the neural network, and conducts comprehensive judgment after deep correlation and understanding, which greatly improves the Accuracy rate, applicable to most general inquiry and interactive application scenarios.
Description
technical field [0001] The present invention relates to the technical field of emotion recognition, in particular, to machine learning, deep learning, computer vision, natural language processing, speech recognition, human action recognition, non-contact physiological detection, etc. based on multi-modal emotion recognition systems. Signal analysis subsystem. Background technique [0002] Emotion recognition is a technology for judging people's emotional changes. It mainly collects people's external expressions and behavior changes to infer people's psychological state. In modern society, emotion recognition technology is widely used in the development of smart devices, sales guide robots, health management, advertising and marketing, etc. Emotion is a state that integrates people's feelings, thoughts, and behaviors. It includes people's psychological responses to external or self-stimuli, as well as the physiological responses that accompany such psychological responses. ...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G10L25/63G10L25/30G10L15/18G10L15/24G10L15/25G06K9/00G06K9/62G06N3/04
CPCG10L15/1822G10L15/24G10L15/25G10L25/30G10L25/63G06V40/16G06V40/174G06V40/20G06V20/49G06N3/045G06F18/253
Inventor 俞旸凌志辉
Owner 南京云思创智信息科技有限公司