Video Call Emotion Feedback via Facial Feature Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video call services lack the ability to effectively convey and utilize facial expression information to enhance user interaction, leading to awkward atmospheres and suboptimal communication experiences.
Innovation Solution
A terminal and server system that analyzes facial expression information using facial feature points to determine emotion states, providing this information to users during video calls, allowing for real-time emotion visualization and personalized recommendations based on accumulated data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If video call services are provided without facial expression analysis, then device complexity is reduced, but user interaction quality deteriorates
Solution Approach 1:
The patent introduces a server as an intermediary that performs facial expression analysis and emotion determination. The terminal devices transmit video streams to the server, which then processes the facial feature points and returns emotion information. This mediator approach allows complex processing to be offloaded from individual terminals while still providing enhanced user interaction quality through emotion feedback.
Solution Approach 2:
The patent replaces manual interpretation of facial expressions with automated computer vision technology. Facial feature point detection and emotion classification algorithms automatically analyze video streams to determine emotional states, substituting the mechanical process of human observation and interpretation with an automated digital system.
2Productivity
If facial expression information is analyzed in real-time, then communication effectiveness is improved, but processing time increases
Solution Approach 1:
The system performs preliminary actions by continuously analyzing facial expressions during the video call and accumulating emotion information over time. This allows the system to have emotion data ready when needed for recommendations or feedback, rather than processing everything from scratch at each moment.
Solution Approach 2:
The patent implements feedback mechanisms where emotion information is provided back to users in real-time during video calls. This feedback loop allows users to understand each other's emotional states, improving communication effectiveness by enabling users to adjust their behavior based on the emotional feedback received.
3Ease of operation
If emotion information is provided to users, then communication quality is enhanced, but information privacy concerns increase
Solution Approach 1:
The patent extracts only the essential emotion information from facial expressions rather than processing or storing complete facial data. By taking out only the relevant emotional state indicators and discarding the rest of the facial information, the system provides communication enhancement while minimizing privacy intrusion.
Data Source
AI summary
There is provided an application stored in a computer-readable storage medium for a first terminal to perform a method of providing a video call service, the method including: establishing a video call session between the first terminal of a first user and a second terminal of a second user; preparing facial expression information of the second user accumulated in at least one video call session executed by the second terminal before the video call session; determining emotion information corresponding to the facial expression information of the second user based on the facial expression information of the second user; and providing the determined emotion information through an execution screen of the first terminal.