3D Avatar Emotion Mapping for Consistent Cross-Channel Expression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing communication applications lack nuanced, personalized, and consistent emotional expression across different communication channels, offering limited expressive range and static experiences.
Innovation Solution
A system that allows users to create or import 3D avatars, define custom emotions through body language recordings, and associate animations and audio with specific emotions, enabling consistent emotional expression across chat, video calls, and audio calls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If emojis and animated GIFs are used to convey emotions, then basic emotional expression is achieved, but expressive range is limited and personalization is lacking
Solution Approach 1:
The patent implements dynamic 3D avatars that can change their appearance, expressions, and animations in real-time based on the user's emotional state. The avatars transition from static emojis to dynamic, context-aware representations that adapt to the communication scenario, enabling nuanced emotional expression while managing complexity through automated emotion detection algorithms.
Solution Approach 2:
The system creates virtual copies of users in the form of 3D avatars that replicate user emotions and expressions. These avatars serve as personalized representations that can express emotions more richly than traditional emojis, providing both personalization and expanded expressive range through computational modeling of human emotion.
2Adaptability or versatility
If pre-programmed animations are used during video calls, then basic emotion conveyance is possible, but personalization and real-time adaptation are lacking
Solution Approach 1:
The system incorporates feedback loops where emotion detection algorithms continuously monitor user input (text, audio, video) and adjust the avatar's expressions and animations in real-time. This closed-loop system automatically adapts the emotional representation to match the user's actual state, enabling real-time adaptation without requiring manual user input for each emotion adjustment.
Solution Approach 2:
The avatars perform self-adjustment based on detected emotional states, automatically selecting and displaying appropriate expressions and animations without user intervention. The system serves itself by autonomously interpreting user emotions and translating them into corresponding avatar behaviors, reducing the burden on users while maintaining high adaptability.
3Adaptability or versatility
If static emoji expressions are used, then simplicity is maintained, but emotional nuance and consistency across communication channels are limited
Solution Approach 1:
The patent transitions from two-dimensional static emojis to three-dimensional dynamic avatars, adding spatial and temporal dimensions to emotional expression. The 3D avatars can change their pose, expression, and animation in real-time, providing emotional nuance and consistency across different communication channels (chat, video, audio) while managing complexity through standardized emotion mapping frameworks.
Data Source
AI summary
The invention discloses a method for sharing emotions within communication media using expressive 3D avatars. Users can create or import personalized 3D avatars that represent themselves (optional). The core functionality involves defining “emotion-mojis” by associating predefined animations and/or user-generated animations with specific emotions. These emotion-mojis can also include audio sounds for a richer emotional expression. During communication, users can select an emotion-mojis and initiate the playback of the corresponding animation (visual and/or audio) for their 3D avatar, allowing them to visually and/or audibly express their emotions to other participants. The invention further provides methods for automatic emotion detection through real-time analysis of user input (webcam video and microphone audio) to infer the user's emotional state and automatically play a corresponding emotion-moji. Additionally, users can define their own custom emotion-mojis by recording their body movements and/or facial expressions and associating them with specific emotions. This invention provides a novel approach to emotional expression in communication media by utilizing personalized 3D avatars, predefined and user-generated emotion-mojis, and real-time emotion detection capabilities, fostering a more engaging and nuanced communication experience.