A speech emotion recognition method and system integrating crowd information

A technology of speech emotion recognition and crowd information, applied in speech analysis, instruments, etc., can solve the problems of poor generalization and low recognition rate of emotion recognition, and achieve the effect of improving the overall accuracy

Active Publication Date: 2021-06-29
ZHEJIANG LAB
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the current technology, because only the shallow information of speech is considered and a simple network structure is used, the recognition rate of emotion recognition is relatively low, and the generalization is relatively poor.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A speech emotion recognition method and system integrating crowd information
  • A speech emotion recognition method and system integrating crowd information
  • A speech emotion recognition method and system integrating crowd information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] In order to make the purpose, technical solution and technical effect of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings.

[0056] Such as figure 1 As shown, a speech emotion recognition system that integrates crowd information includes:

[0057] The voice signal acquisition module is used to collect user voice signals, generally using a high-fidelity single microphone or microphone array to reduce the distortion of voice signal acquisition;

[0058] The voice signal preprocessing module is used to preprocess the collected voice signal, detect the endpoint of the voice, remove the silent segment before and after the voice, and generate data that can be used for neural network processing. Specifically: the module pre-emphasizes the voice , framing, windowing, short-time Fourier transform, trigonometric function filtering, silence removal and other operations, convert the speech ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of artificial intelligence, and specifically relates to a voice emotion recognition method and system that integrates crowd information. The method includes the following steps: S1, collecting user voice signals; S2, preprocessing the voice signals, and obtaining the mel spectrum; S3, removing Silent segments before and after the Mel spectrum; S4. Obtaining in-depth crowd information through the crowd classification network; S5. Obtaining the depth information of the Mel spectrum through the Mel spectrum preprocessing network; S6. Obtaining fusion information through SENet fusion features; S7. Through the classification network , to get the emotion recognition structure. The present invention fuses crowd information features to make emotional feature extraction more accurate, performs information fusion through the channel attention mechanism of SENet, can effectively extract deep features, and improves overall recognition accuracy.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and in particular relates to a speech emotion recognition method and system for fusing crowd information. Background technique [0002] Language interaction is one of the earliest ways of human communication, so speech has become the main way for humans to express emotions. With the rise of human-computer interaction, intelligent speech sentiment analysis is becoming more and more important. At present, the main classification of emotions is the seven emotions proposed by Ekman in the last century, namely: neutral, happy, sad, angry, afraid, disgusted, and surprised. [0003] The current mainstream speech emotion recognition methods are based on traditional algorithms or deep learning methods based on simple neural network architectures. The basic process based on the traditional method is: feature extraction of speech, and emotion classification of speech through features. Among them, t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G10L25/63G10L25/30G10L25/24
CPCG10L25/63G10L25/30G10L25/24G06N3/045G06N3/0442G10L25/18G10L25/21
Inventor 李太豪郑书凯刘昱龙裴冠雄马诗洁谢冰
Owner ZHEJIANG LAB
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products