3D Avatar Messaging in AR Space for Immersive Cross-Device Chat
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Adapting messaging applications for augmented reality (AR) devices poses challenges due to differences in input and output mechanisms compared to conventional computing devices, resulting in a non-immersive user experience when traditional interfaces are scaled for AR devices.
Innovation Solution
An improved messaging system allows users of AR devices to interact with 3-D avatars anchored in real-world environments, enabling immersive communication by mapping specific characters or emojis to avatar animations, and utilizing computer vision for relocalization and presence detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional messaging interfaces are scaled for AR devices, then device compatibility is maintained, but user experience becomes non-immersive and less interactive
Solution Approach 1:
The patent transitions from traditional 2D messaging interfaces to 3D immersive interfaces in AR space. Messages are displayed in three-dimensional space with spatial positioning, allowing users to interact with avatars and content in an immersive AR environment rather than scaling down conventional 2D interfaces.
Solution Approach 2:
The patent introduces 3D avatars as intermediaries to represent users in AR space. These avatars enable natural interaction through gestures, expressions, and spatial positioning, serving as a mediator between the user and the messaging system, thereby enhancing immersion and interactivity.
2Ease of operation
If 3-D avatars are implemented in AR space, then user immersion and interactivity are enhanced, but system complexity increases due to computer vision and relocalization requirements
Solution Approach 1:
The patent implements relocalization technology that automatically detects and restores the AR environment and avatar positions when users re-enter a space. The system self-corrects by recognizing spatial features and repositioning avatars without requiring manual user configuration, thereby managing complexity through automation.
Solution Approach 2:
The patent employs computer vision systems that continuously monitor the AR environment, user position, and avatar states. This feedback loop enables automatic adjustment of avatar positioning, gesture recognition, and spatial rendering, managing system complexity through real-time adaptive control.
3Loss of information
If avatar animations are mapped to specific characters and emojis, then message expressiveness is enhanced, but processing requirements and computational load increase
Solution Approach 1:
The patent pre-maps characters and emojis to corresponding avatar animations and gestures during system setup or content creation. This preliminary action creates a lookup table or mapping database that enables rapid retrieval and execution of animations during messaging, reducing real-time computational load while maintaining high expressiveness.
4Reliability
If presence and activity indicators are maintained across different device types, then communication reliability is improved, but data synchronization and management complexity increase
Solution Approach 1:
The patent implements a universal presence and activity indicator system that functions across different device types (mobile devices, AR devices, desktop computers). The same indicator mechanisms (showing user presence, typing status, online state) are maintained across all platforms, enabling consistent communication reliability through a unified multi-functional system.
Data Source
AI summary
Described herein are techniques for facilitating the communication of text-based messages between end-users who are using messaging applications executing on client-based computing devices with different capabilities. Specifically, the messaging system described herein enables a first end-user to add a message element to a text-based message, which, when received by a message recipient using an augmented reality messaging application, will cause a 3-D avatar representing the message sender, to animate in accordance with a specific avatar animation associated with the message element. The message element may be an emoji, or a special sequence of characters, and may be a visible or invisible (e.g., meta-data) element of the text-based message.