Emotion recognition method and device based on audio and video data, equipment and storage medium

A technology for audio data and emotion recognition, applied in speech analysis, instruments, electrical components, etc., can solve problems such as mood swings and customer unhappiness, and achieve the effect of satisfying automation

Pending Publication Date: 2021-06-04
PING AN TECH (SHENZHEN) CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the process of talking to customers through audio and video between bank customer service staff and customers, the customer may be unhappy and have emotional fluctuations due to some reasons

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Emotion recognition method and device based on audio and video data, equipment and storage medium
  • Emotion recognition method and device based on audio and video data, equipment and storage medium
  • Emotion recognition method and device based on audio and video data, equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0043] The emotion recognition method based on audio and video data provided by the embodiments of the present invention can be applied to an emotion recognition device based on audio and video data. In some embodiments, the emotion recognition device based on audio and video data is set in a computer device . In some embodiments, the computer device includes, but is not limited to, one or more of a smartphone, a tablet computer, a laptop computer...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention relates to the field of artificial intelligence, and discloses an emotion recognition method and device based on audio and video data, equipment and a storage medium, and the method comprises the steps: obtaining the audio and video data; identifying and analyzing audio data in the audio and video data, and extracting audio feature information; identifying and analyzing video data in the audio and video data, and extracting video frame feature information; inputting the audio feature information and the video frame feature information into an emotion recognition model for testing to obtain the emotion of the customer corresponding to the audio and video data; and determining a specified text corresponding to the emotion of the customer from the standard language library, sending the specified text to a user terminal corresponding to the customer, and outputting and displaying the specified text on a display interface of the user terminal. In this way, the customer emotion can be automatically, quickly and accurately recognized, and the specified text corresponding to the customer emotion is output. The invention relates to a block chain technology, for example, audio and video data can be written into a block chain so as to be used for scenes such as data evidence obtaining.

Description

technical field [0001] The present invention relates to the field of artificial intelligence, in particular to an emotion recognition method, device, equipment and storage medium based on audio and video data. Background technique [0002] With the development of communication technology, the application of audio and video is becoming more and more extensive. At present, many business fields, such as the banking industry, conduct various business operations through audio and video. For example, bank customer service employees and customers communicate through audio and video. However, in the process of talking to customers through audio and video between bank customer service staff and customers, some reasons may cause customers to be unhappy and have emotional fluctuations. Therefore, how to quickly and effectively identify customer sentiment is particularly important. Contents of the invention [0003] Embodiments of the present invention provide an emotion recognition ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/234H04N21/44G10L25/63G10L25/30
CPCG10L25/30G10L25/63H04N21/23418H04N21/44008
Inventor 李健
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap