Third-Person AR View via Handheld Coordinate Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Sharing augmented reality (AR) experiences between AR eyewear and mobile devices is challenging due to complex setup procedures and limited viewer interaction, often requiring first-person perspectives and significant effort from content creators.
Innovation Solution
A method for establishing a shared coordinate system between AR eyewear and mobile devices using fiducial markers or environment mapping, allowing for quick calibration and enabling third-person perspective viewing, with a one-button initiation process for simplified sharing and synchronized positional tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If direct video feed streaming is used to share AR experiences, then the setup procedure is simplified, but the viewer's ability to independently explore the augmented environment is limited
Solution Approach 1:
The patent introduces a mobile device as an intermediary between the AR eyewear and the viewer. The mobile device receives AR content from the eyewear, processes it through coordinate system transformations, and displays it on its screen. This intermediary enables the viewer to explore the AR environment independently from a third-person perspective while maintaining simplified setup procedures.
Solution Approach 2:
The patent transforms the AR experience from a first-person perspective (single dimension of viewing) to a third-person perspective by introducing a mobile device display dimension. This allows the viewer to see the AR content as if observing the AR user's field of view, enabling independent exploration without being constrained to the AR user's exact viewpoint.
2Adaptability or versatility
If complex multiplayer features are implemented to enable shared AR experiences, then the viewer interaction is enhanced, but the effort required from content creators increases significantly
Solution Approach 1:
The patent creates a universal sharing mechanism that works with any existing AR content without requiring content creators to implement special multiplayer features. The mobile device application handles the complexity of coordinate system alignment and synchronization, making shared AR experiences accessible to content creators while enhancing viewer interaction capabilities.
Solution Approach 2:
The system enables self-service sharing where the mobile device automatically performs coordinate system calibration and alignment using fiducial markers or environment mapping. This eliminates the need for content creators to manually configure complex multiplayer settings, as the system autonomously establishes the shared coordinate framework.
3Productivity
If fiducial markers are used for coordinate system alignment, then the calibration speed is improved, but the complexity of the setup process increases
Solution Approach 1:
The patent incorporates fiducial markers that are prepared in advance and can be easily displayed on mobile device screens. These pre-prepared markers enable rapid coordinate system alignment when needed, as the markers are already designed and ready for detection, eliminating the need for complex real-time calibration procedures.
Data Source
AI summary
A method for sharing a display of a mixed reality experience is described. In one aspect, the method includes pairing a head-wearable device with a handheld device to establish a shared coordinate system, and displaying, based on a pose of the handheld device, a virtual object of a first mixed reality application operating at the head-wearable device, with a second mixed reality application operating at the handheld device using the shared coordinate system.