Virtual Content Display Using Spatial Relationship Criteria
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies struggle to effectively display virtual content in response to spatial relationships between a device and objects in a physical environment, leading to inconsistent and user-unfriendly interactions.
Innovation Solution
A device is equipped with a camera and display, capable of detecting objects and determining spatial relationships that satisfy display criteria, allowing it to render virtual content in association with physical objects, using transforms to maintain virtual object positions relative to the physical environment or device coordinates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual content is displayed in response to detecting an object, then the interaction becomes more dynamic, but the spatial consistency and user experience become inconsistent
Solution Approach 1:
The system changes display parameters (virtual content visibility, position, orientation) based on detected spatial parameters (distance, angle, position) between the device and physical objects. This allows dynamic interaction while maintaining spatial consistency through coordinated parameter transformation.
Solution Approach 2:
The system continuously monitors spatial relationships between the device and objects, uses this feedback to determine whether display criteria are met, and adjusts virtual content display accordingly. This closed-loop feedback mechanism ensures both dynamic responsiveness and spatial consistency.
2Adaptability or versatility
If virtual content is displayed based on spatial relationship, then the mixed reality experience is enhanced, but the complexity of determining and maintaining spatial criteria increases
Solution Approach 1:
The device integrates multiple functions (object detection, spatial relationship calculation, display criteria evaluation, and virtual content rendering) into a unified system. This multi-functionality reduces overall system complexity by eliminating the need for separate dedicated components for each function.
Solution Approach 2:
The system introduces an intermediary processing layer that transforms complex spatial relationship data into simplified display decisions. This intermediary layer evaluates spatial parameters against predefined criteria and outputs clear instructions for virtual content display, reducing the complexity burden on the rendering system.
3Reliability
If virtual object positions are maintained relative to physical environment, then the integration becomes seamless, but the computational transforms required increase processing complexity
Solution Approach 1:
The system performs preliminary calculations of transform parameters (rotation matrices, translation vectors) based on detected spatial relationships before rendering virtual content. By pre-computing these transforms, the system reduces real-time processing complexity while maintaining seamless integration of virtual objects with the physical environment.
Data Source
AI summary
In one implementation, a method of displaying virtual content is performed at a device in a physical environment, the device having a display, one or more processors, and non-transitory memory. The method includes detecting an object in the physical environment. The method includes determining that a spatial relationship between the device and the object satisfies one or more display criteria. The method includes, in response to determining that the spatial relationship between the device and the object satisfies the one or more display criteria, displaying, on the display, virtual content.