Speech emotion recognition method based on speech spectrum

A technology of emotion recognition and spectrogram, which is applied in speech analysis, instruments, etc., can solve the problems of small data sets, insufficient consideration of factors, and insufficient extraction of speech emotion features, so as to achieve efficient learning and improve the accuracy rate.

Active Publication Date: 2021-03-30
CHONGQING UNIV OF POSTS & TELECOMM
View PDF8 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, the combination of artificial intelligence and deep learning has made great progress in the application of speech emotion recognition. However, when using traditional neural networks and single neural networks for feature extraction and model training, due to the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speech emotion recognition method based on speech spectrum
  • Speech emotion recognition method based on speech spectrum
  • Speech emotion recognition method based on speech spectrum

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055]The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0056] A spectrogram-based speech emotion recognition method, such as figure 2 As shown, the method includes: acquiring voice signals in real time, converting the voice signals into spectrograms; inputting the spectrograms into the trained speech emotion recognition model to recognize speech emotions; the speech emotion recognition model includes attention-based Mechanism of residual neural network and long short-term memory neural network LSTM.

[0057] The ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of artificial intelligence, voice processing and emotion calculation, and particularly relates to a speech emotion recognition method based on a speech spectrum. Themethod comprises the following steps of: acquiring a speech signal in real time, and converting the speech signal into a speech spectrum; and inputting the speech spectrum into a trained speech emotion recognition model to recognize speech emotion, wherein the speech emotion recognition model comprises a residual neural network based on an attention mechanism and a long short-term memory (LSTM) neural network. According to the invention, the neural network and the attention model are combined together, so that the effective features of the speech energy value in the speech spectrum can be learned more efficiently, and the accuracy of speech emotion recognition is improved.

Description

technical field [0001] The invention belongs to the fields of artificial intelligence, speech processing and emotional computing, and in particular relates to a speech emotion recognition method based on spectrograms. Background technique [0002] Speech emotion recognition is an important component of affective computing. With the development of deep learning and artificial intelligence, emotion recognition has broad application prospects in the field of human-computer interaction, and has received extensive attention from researchers. In 1995, Professor Picard of the Massachusetts Institute of Technology proposed the concept of affective computing. In 2003, the Institute of Automation of the Chinese Academy of Sciences and other units hosted the first China Affective Computing and Intelligent Interaction Academic Conference in Beijing. In 2005, the first International Affective Computing and Intelligent Interaction Academic Conference was hosted in Beijing. Experts in th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L25/63G10L25/30G10L25/03
CPCG10L25/63G10L25/30G10L25/03
Inventor 杨丽佳舒坤贤
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap