Partially Display-Locked Virtual Objects for Mixed Reality Stability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies struggle to effectively display virtual objects in mixed reality environments that maintain their location relative to the physical environment while allowing for dynamic movement of the device, leading to inconsistent positioning and user experience.
Innovation Solution
Implementing a system where virtual objects are partially display-locked and partially world-locked, allowing portions to maintain their position on the display while others adjust based on device movement, using coordinate transformations to ensure accurate rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If a virtual object is completely display-locked to maintain its position on the display, then the virtual object remains stable on the display, but it cannot maintain accurate positioning relative to the physical environment during device movement
Solution Approach 1:
The virtual object is divided into multiple portions, where each portion can have different locking characteristics. Some portions are display-locked while others are world-locked, allowing the system to balance stability and positioning accuracy by applying different transformation rules to different segments of the same object
Solution Approach 2:
Different portions of the virtual object have different quality attributes regarding their locking behavior. The system applies local quality by making specific portions display-locked while making other portions world-locked, allowing each portion to optimize for its specific functional requirements
2Measurement precision
If a virtual object is completely world-locked to maintain its location in the physical environment, then the virtual object maintains accurate positioning relative to the physical environment, but it becomes unstable on the display during device movement
Solution Approach 1:
The virtual object is segmented into portions with different locking characteristics, allowing the system to distribute the burden of transformation between display-locked and world-locked portions, thereby maintaining both positioning accuracy and display stability
Solution Approach 2:
The system dynamically determines which portions of the virtual object should be display-locked versus world-locked based on the device's motion state. During device movement, the system can adjust the locking characteristics of different portions to maintain coherence while adapting to changing environmental conditions
3Device complexity
If the entire virtual object uses the same locking mechanism, then the system is simple to implement, but it cannot provide both display stability and environmental positioning accuracy simultaneously
Solution Approach 1:
The locking system is segmented into different types (display-locked and world-locked) that can be applied to different portions of virtual objects, enabling the system to achieve reliable positioning while maintaining manageable complexity through modular design
Solution Approach 2:
The system creates a universal locking mechanism that can operate in multiple modes (display-locked, world-locked, or hybrid) depending on the requirements of each virtual object and the current device state, providing reliability across different scenarios without requiring entirely separate systems
Data Source
AI summary
In one implementation, a method of displaying a virtual object is performed at a device with a display, one or more processors, and non-transitory memory. The method includes determining a first display location in a two-dimensional display coordinate system for a first portion of a virtual object. The method includes detecting an object at an object location in a three-dimensional world coordinate system. The method includes determining, based on the object location, a first world location in the three-dimensional world coordinate system for a second portion of the virtual object. The method includes determining a second display location in the two-dimensional display coordinate system for the second portion of the virtual object based on the first world-location in the three-dimensional world coordinate system and a first pose of the device. The method includes displaying, on the display, the virtual object, wherein the first portion is displayed at the first display location and the second portion is displayed at the second display location.