Anchored 3D Avatars for Immersive AR Messaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Adapting messaging applications for augmented reality (AR) devices poses challenges due to differences in input and output mechanisms compared to conventional computing devices, resulting in a non-immersive user experience when traditional interfaces are scaled for AR devices.
Innovation Solution
An improved messaging system allows end-users of AR devices to interact with 3-D avatars anchored in real-world environments, enabling immersive communication by using computer vision for relocalization and supporting presence and activity detection, with messages containing instructions for avatar animations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional messaging interfaces are scaled for AR devices, then device compatibility is maintained, but user experience becomes non-immersive and interactive
Solution Approach 1:
The patent transitions from traditional 2D messaging interfaces to 3D immersive interfaces in AR space. Messages are displayed in three-dimensional virtual space with spatial positioning, allowing users to interact with messages as if they exist in the physical environment. This dimensional transformation creates an immersive experience while maintaining cross-device compatibility through standardized communication protocols.
Solution Approach 2:
The system introduces AR-specific message elements and avatar representations as intermediaries between traditional messaging systems and AR devices. These intermediaries translate conventional text messages into immersive AR experiences with avatars, gestures, and spatial positioning, enabling seamless integration across different device types while providing enhanced AR-specific interactions.
2Adaptability or versatility
If messaging applications are adapted for AR devices with different input/output mechanisms, then AR-specific functionality is enabled, but system complexity increases
Solution Approach 1:
The patent creates a universal messaging framework that handles multiple device types through a common interface. The system uses standardized message structures that can be rendered differently across devices - traditional text for conventional devices and immersive AR elements for AR devices. This multi-functional approach allows the same messaging system to serve both AR and non-AR platforms without requiring separate complex implementations.
Solution Approach 2:
The system dynamically adjusts message rendering parameters based on device capabilities. Message content, positioning, and presentation format are modified according to whether the device is an AR device or a traditional device. This parameter-based adaptation allows flexible functionality across devices while maintaining a unified system architecture that doesn't require separate complex code paths for each device type.
Data Source
AI summary
Described herein is a messaging application that executes on a wearable augmented reality device. The messaging application facilitates the anchoring or pinning of a 3-D avatar representing another end-user. An end-user wearing the AR device facilitates messaging with the other end-user via interactions with the 3-D avatar representing the other end-user. As such, the AR device processes various sensor inputs to detect when the end-user wearing the AR device is “targeting” the 3-D avatar, and enables an audio recording device to record an audible message for communicating to the other end-user.