Emotion recognition method and device, computer equipment and storage medium

A technology of emotion recognition and computer programs, which is applied in the field of emotion recognition and computer program products, and can solve the problems of low accuracy of emotion recognition

Pending Publication Date: 2022-08-05
SHENZHEN ZHUIYI TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when traditional technology fuses speech and text, the fusion method is relatively simple, resulting in low accuracy of emotion recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emotion recognition method and device, computer equipment and storage medium
  • Emotion recognition method and device, computer equipment and storage medium
  • Emotion recognition method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] In order to make the objectives, technical solutions and advantages of the present application more clear, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

[0074] The emotion recognition method provided in the embodiments of the present application can be applied to, for example, figure 1 in the application environment shown. The terminal 102 communicates with the server 104 through the network. The data storage system may store data that the server 104 needs to process. The data storage system can be integrated on the server 104, or it can be placed on the cloud or other network server. The server 104 acquires the voice data sent by the terminal 102, and extracts the first text feature and the corresponding voice feature in the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an emotion recognition method. The method comprises the steps of obtaining a first text feature in voice data and a corresponding first frequency cepstrum feature and a voiceprint feature; performing cross attention fusion on the first text feature and the first frequency cepstrum feature to obtain a second text feature and a second frequency cepstrum feature; encoding the second frequency cepstrum feature and the voiceprint feature to obtain a first audio encoding feature and a second audio encoding feature; encoding the first text feature and the second text feature to obtain a first text encoding feature and a second text encoding feature; performing multi-head attention fusion on the first audio coding feature and the first text coding feature to obtain a first fusion feature; obtaining a second fusion feature from the first fusion feature according to a dynamic routing algorithm; and obtaining an emotion recognition result according to the second fusion feature, the second text coding feature and the second audio coding feature. According to the method, the text features and the voice features corresponding to the voice data can be fully utilized, and high-precision emotion recognition is realized.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence, and in particular, to an emotion recognition method, apparatus, computer equipment, storage medium and computer program product. Background technique [0002] With the rapid development of artificial intelligence and the help of deep learning, the field of human-computer interaction has received more and more attention from researchers. As an important branch of human-computer interaction, emotion recognition has also become a current hot research direction. At present, most of the research on emotion recognition focuses on single-modal fields such as speech, facial expressions, and text. As the most direct means of people's communication, speech contains rich emotional information, and changes in people's emotions can be reflected through speech features. Speech emotion recognition is to convert the input speech signal containing emotional information into readable ph...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L25/63G10L25/24G10L15/26G06K9/62G06N3/04
CPCG10L25/63G10L25/24G10L15/26G06N3/045G06F18/24G06F18/253
Inventor 张文泽文博刘云峰
Owner SHENZHEN ZHUIYI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products