Voice signal analysis sub-system based on multi-modal emotion identification system

A technology of emotion recognition and speech signal, applied in speech analysis, character and pattern recognition, speech recognition, etc., can solve the problems of unintegrated human expressions, spoken words, body, voice, intonation and physiological characteristics, etc., to improve emotion analysis , Improve the convenience of use, reduce the requirements of the environment and hardware

Active Publication Date: 2018-11-27
南京云思创智信息科技有限公司
View PDF6 Cites 29 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it does not integrate people's facial expressions, spoken wo...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Voice signal analysis sub-system based on multi-modal emotion identification system
  • Voice signal analysis sub-system based on multi-modal emotion identification system
  • Voice signal analysis sub-system based on multi-modal emotion identification system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] The invention will be further elaborated below in conjunction with the accompanying drawings and specific embodiments.

[0061] Because the production of any emotion is accompanied by certain changes in the body, such as facial expressions, muscle tension, and visceral activities. Using these signal changes to directly perform emotion recognition is the so-called basic recognition method, also known as a single-modal emotion recognition method. The current main methods include facial images, language, text, gestures and physiological signals. The present invention proposes to integrate, correspond and reason the understanding of emotions by computers in each of the following single modes to obtain a more complete and accurate emotion recognition method and system.

[0062] The emotion recognition system based on multimodal that present embodiment proposes, its system is made up of following several parts ( figure 1 It is a schematic diagram of a multimodal emotion reco...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a voice signal analysis sub-system based on a multi-modal emotion identification system. The sub-system comprises a data acquisition device and an output device and is characterized in that the sub-system also comprises an emotion analysis software system; the emotion analysis software system carries out comprehensive analysis reasoning on data obtained by the data acquisition device and the outputs a result to the output device finally; and the emotion analysis software system comprises a voice-signal emotion identification sub-system. According to the invention, emotion identification based on five single modes is ingenuously provided; a depth neural network is creatively used for carrying out comprehensive judgment on multiple single modes after the single modesare subjected to coding of a neural network and deep association and understanding; accuracy is greatly improved; and the sub-system is suitable for most of general inquiry interactive application scenes.

Description

technical field [0001] The present invention relates to the technical field of emotion recognition, in particular, to machine learning, deep learning, computer vision, natural language processing, speech recognition, human action recognition, non-contact physiological detection, etc. based on multi-modal emotion recognition systems. Signal analysis subsystem. Background technique [0002] Emotion recognition is a technology for judging people's emotional changes. It mainly collects people's external expressions and behavior changes to infer people's psychological state. In modern society, emotion recognition technology is widely used in the development of smart devices, sales guide robots, health management, advertising and marketing, etc. Emotion is a state that integrates people's feelings, thoughts, and behaviors. It includes people's psychological responses to external or self-stimuli, as well as the physiological responses that accompany such psychological responses. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L25/63G10L25/30G10L15/18G10L15/24G10L15/25G06K9/00G06K9/62G06N3/04
CPCG10L15/1822G10L15/24G10L15/25G10L25/30G10L25/63G06V40/16G06V40/174G06V40/20G06V20/49G06N3/045G06F18/253
Inventor 俞旸凌志辉
Owner 南京云思创智信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap