Displayed Marker Tracking for Relative Device Pose in CGR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to accurately track the relative location of separate electronic devices, such as mobile phones, within computer-generated reality environments, preventing the display of these devices or their representations to guide user interactions.
Innovation Solution
A first device, like a head-mounted display, uses an image sensor to detect a marker on a second device, like a mobile phone, to determine its relative position and orientation, allowing a virtual representation of the second device to be displayed at a corresponding real-world location, and adjusts this position over time using IMU data and additional images, with adaptive markers and light-based indicators for synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a marker is displayed on the second device to enable tracking, then the ability to determine relative position and orientation is improved, but the device complexity increases due to additional markers and tracking mechanisms
Solution Approach 1:
The patent creates a virtual representation (copy) of the second device within the CGR environment displayed on the first device. This virtual copy includes virtual content that replaces the physical marker, allowing the system to track and interact with the second device through its virtual representation rather than directly observing the physical marker, thereby simplifying the tracking mechanism while maintaining precision.
Solution Approach 2:
The patent introduces a virtual representation as an intermediary between the physical second device and the CGR environment. This virtual representation mediates the interaction by translating physical device positions and orientations into corresponding virtual positions, allowing control signals to be generated based on the virtual representation's location rather than direct marker tracking.
2Ease of operation
If the relative position is tracked continuously to improve interaction accuracy, then the user interaction quality is improved, but the loss of time increases due to continuous processing requirements
Solution Approach 1:
The patent performs preliminary actions by establishing the virtual representation of the second device in advance within the CGR environment. Once this virtual representation is created, subsequent tracking and interaction operations can proceed more efficiently by operating on the pre-established virtual model rather than continuously processing raw marker data from scratch.
3Reliability
If the marker is made adaptive to changing lighting conditions to improve detection reliability, then the measurement precision is improved, but the device complexity increases due to adaptive marker adjustments
Solution Approach 1:
The patent employs parameter changes by making the marker adaptive to lighting conditions through adjustments in marker appearance or detection parameters. The system can modify marker visibility characteristics or detection sensitivity based on environmental lighting conditions, thereby maintaining reliable detection across varying conditions without requiring fundamentally complex adaptive hardware.
Data Source
AI summary
Some implementations provide improved user interfaces for interacting with a virtual environment. The virtual environment is presented by a display of a first device having an image sensor. The first device uses the image sensor to determine a relative position and orientation of a second device based on a marker displayed on a display of the second device. The first device uses the determined relative position of the second device to display a representation of the second device including virtual content in place of the marker.