Emotion Analysis System for Video Communication Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current communication platforms, such as video calls and video conferences, often face misunderstandings and lost productivity due to lack of familiarity and cultural differences between users, leading to inadequate verbal feedback, which can negatively impact relationships.

Innovation Solution

Analyzing videos of users to determine their emotional features, including visual and audio cues, to generate an emotion profile that can be displayed to the other user, allowing for better feedback and interaction during communication sessions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If video communication platforms are used for user interaction, then communication capability is improved, but misunderstandings and lost productivity occur due to lack of emotional feedback

Engineering Contradiction:
Improvecommunication capabilityVSAvoidemotional feedback
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system analyzes video feeds to detect user emotions through facial expressions and audio cues, then provides real-time emotional feedback to both users. This feedback loop allows users to understand each other's emotional states, compensating for the lack of in-person emotional cues in video communication and reducing misunderstandings.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

An emotion analysis system acts as an intermediary between users, processing video and audio data to generate emotional insights. This intermediary component translates raw visual and auditory signals into meaningful emotional information that users can interpret, bridging the gap in emotional communication.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If emotion analysis is implemented in real-time video communication, then emotional feedback is improved, but computational complexity and processing time increase

Engineering Contradiction:
Improveemotional feedbackVSAvoidcomputational complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The emotion analysis system is divided into separate modules: facial expression analysis, audio emotion detection, and emotion synthesis. Each module processes specific aspects independently, allowing for optimized computation and reducing overall system complexity while maintaining real-time performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system focuses on detecting a limited set of key emotions (e.g., happiness, sadness, anger, neutrality) rather than attempting to analyze all possible emotional states. This partial action approach reduces computational requirements while still providing meaningful emotional feedback for effective communication.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11443554B2Determining and presenting user emotion
Publication Date: 2022.09.13 VERIZON PATENT & LICENSING INC
  • US11443554B2 patent drawing
  • US11443554B2 patent drawing
  • US11443554B2 patent drawing

AI summary

One or more computing devices, systems, and/or methods are provided. One or more videos associated with a user may be analyzed to determine a first set of features of the user associated with a first emotion of the user and/or a second set of features of the user associated with a second emotion of the user. A first user emotion profile associated with the user may be generated based upon the first set of features and/or the second set of features. A second video may be presented via a graphical user interface of a first client device. The user may be identified within the second video. It may be determined, based upon the second video and/or the first user emotion profile, that the user is associated with the first emotion. A representation of the first emotion may be displayed via the graphical user interface of the first client device.