Emotion Recognition via Probability Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current emotion recognition methods are limited by relying on single types of data, which affects accuracy and precision, especially when combining speech spectrum features and voiceprint features extracted from audio and text content.

Innovation Solution

A data processing method that performs emotion prediction on current information to obtain a current emotion direction and first probability, determines a second probability based on an emotion transition relationship from historical emotions, and integrates these probabilities to improve emotion recognition accuracy by considering diverse temporal and spatial data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If direct emotion recognition is performed on information using a single type of data, then the recognition process is simple and fast, but the accuracy of emotion recognition is affected

Engineering Contradiction:
Improveaccuracy of emotion recognitionVSAvoidcomplexity of recognition process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple data types (speech spectrum features and voiceprint features) into a unified emotion recognition framework. The speech spectrum information processor extracts emotional features from audio signals, while the voiceprint information processor extracts speaker characteristics, and both are integrated to produce a comprehensive emotion recognition result, thereby improving accuracy through data fusion

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The recognition system is divided into separate functional modules: a speech spectrum information processor for analyzing audio spectral characteristics, a voiceprint information processor for extracting speaker identity features, and an integrator that combines their outputs. This segmentation allows each module to specialize in specific feature extraction while maintaining overall system manageability

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If multiple types of data are combined for emotion recognition, then the accuracy of emotion recognition is improved, but the complexity of the recognition process increases

Engineering Contradiction:
Improveaccuracy of emotion recognitionVSAvoidcomplexity of recognition process
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The integrated information processor serves multiple functions: it receives and processes both speech spectrum data and voiceprint data, performs feature extraction from different data types, and generates emotion recognition results. This multi-functional design consolidates what would otherwise require separate processing systems, managing complexity through functional integration

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240212705A1Data processing method and apparatus, electronic device, computer-readable storage medium, and computer program product
Publication Date: 2024.06.27 TENCENT HLDG LTD
  • US20240212705A1 patent drawing
  • US20240212705A1 patent drawing
  • US20240212705A1 patent drawing

AI summary

A data processing method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product are provided for emotion recognition scenarios such as a cloud technology, artificial intelligence (AI), intelligent transportation, a game, and a vehicle. Data processing methods for emotion recognition includes: performing emotion prediction on information for recognition for a current round to obtain a current emotion direction and a first probability of each of a plurality of candidate emotions, the current emotion direction being a direction of an emotion of the information for recognition; determining a second probability corresponding to each candidate emotion from an emotion transition relationship based on the current emotion direction; integrating the first and second probabilities to obtain a target probability of the candidate emotion; and determining an emotion recognition result based on the target probability corresponding to each of the plurality of candidate emotions.