Anchor-Based Virtual Content Positioning in Mixed Reality
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In computer-generated reality (CGR) systems, existing technologies face challenges in accurately positioning and orienting virtual content relative to the physical environment across multiple users and sessions, often resulting in inconsistent placement and lack of geometric correspondence with physical objects.
Innovation Solution
A method that determines a device location and obtains a content item with both coarse and fine location information, uses this information to identify an anchor in the physical environment, and then determines the precise position and orientation of the content item relative to the anchor for accurate display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If approximate positioning techniques are used, then device complexity is reduced, but measurement precision of content position deteriorates
Solution Approach 1:
The positioning system is segmented into multiple independent components: coarse positioning using device location data (GPS, Wi-Fi trianguulation) and fine positioning using anchor-based visual odometry. This segmentation allows each component to operate independently with appropriate complexity levels, achieving high precision without requiring a single overly complex system.
Solution Approach 2:
Anchor objects serve as intermediaries between the physical environment and virtual content. The anchors provide stable, detectable reference points that enable precise alignment of virtual content with physical spaces without requiring complex direct positioning measurements between the device and the physical environment.
2Device complexity
If approximate positioning techniques are used, then manufacturing precision of content placement deteriorates, but device complexity is reduced
Solution Approach 1:
The system performs preliminary actions by pre-placing anchor objects in the physical environment with known positions and orientations. These pre-positioned anchors serve as reference frames that enable subsequent virtual content to be accurately placed without requiring complex real-time measurement and computation during content placement.
Solution Approach 2:
The patent replaces complex mechanical positioning systems with a computational approach using visual odometry and anchor-based reference frames. Instead of using sophisticated mechanical alignment devices or markers, the system uses image processing and algorithmic computation to achieve precise content placement.
3Device complexity
If approximate positioning techniques are used, then reliability of content positioning deteriorates, but device complexity is reduced
Solution Approach 1:
The system implements feedback mechanisms where the visual odometry module continuously refines position estimates based on observed anchors and environmental features. This feedback loop corrects drift and alignment errors over time, ensuring reliable and consistent content positioning across extended usage periods.
Solution Approach 2:
Multiple anchors are distributed throughout the physical environment to provide redundant reference points. This beforehand cushioning ensures that if one anchor is occluded or becomes unavailable, the system can still maintain reliable positioning using remaining anchors, thereby improving robustness and reliability.
Data Source
AI summary
A method includes identifying a physical object within an environment using a camera of an electronic device, obtaining a content item to be output for display by the electronic device, determining a content position and a content orientation for the content item relative to the physical object, and displaying a representation of the content item using the electronic device so that, from a perspective of a user using the electronic device, the content item replaces the physical object in the environment. The content item is selected based on identifying the physical object.