Spatial 3D Content Matching for Wearable Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for displaying content in spatial 3D environments, such as virtual reality, augmented reality, and mixed reality, are inadequate as they are limited to 2D screens and fail to effectively utilize the spatial nature of these environments, leading to suboptimal performance.
Innovation Solution
The system allows for the display of virtual content in either world-centric or user-centric modes, adjusting its position and size based on user interactions and pose changes, and matches content elements to suitable surfaces in the environment using sensors and logical structures to optimize placement and rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If conventional 2D screen display methods are used in spatial 3D environments, then the display area is limited to the screen area, but the system fails to utilize the spatial nature of the environment, leading to suboptimal performance
Solution Approach 1:
The patent transitions from 2D screen-based display to 3D spatial display by projecting virtual content onto surfaces in a three-dimensional environment. The system uses depth sensors and surface detection algorithms to identify suitable surfaces (walls, tables, etc.) and renders virtual content with proper 3D positioning, orientation, and scaling, thereby utilizing the spatial dimensions of the environment rather than being confined to a 2D plane.
Solution Approach 2:
The patent introduces an intermediary processing layer that includes a surface detector, a content element identifier, and a matcher that bridges the gap between conventional 2D content and the 3D spatial environment. This intermediary system analyzes the physical environment, identifies suitable surfaces, matches content elements to those surfaces, and handles the transformation and rendering of virtual content, thereby enabling seamless integration of 2D display methods with 3D spatial environments.
2Stability of the object's composition
If virtual content is displayed in world-centric mode, then the content position is fixed relative to the environment, but the content does not adapt to user movements and pose changes
Solution Approach 1:
The patent implements a dynamic display mode switching mechanism that allows transition between world-centric and user-centric modes based on user interactions and contextual conditions. In user-centric mode, the virtual content dynamically adjusts its position and orientation relative to the user's head pose and movement, ensuring the content remains visible and interactable. The system uses sensors to track user motion and recalculates content positioning in real-time, creating a dynamic adaptation to user behavior while maintaining compositional stability through controlled transitions between modes.
3Ease of operation
If the system detects surfaces and matches content elements to them, then the content placement is optimized for the environment, but the system complexity increases with sensors and logical structures
Solution Approach 1:
The patent employs a universal surface detection and matching framework that can work with multiple types of surfaces (walls, tables, floors, virtual surfaces) and various content elements (videos, images, 3D objects, text) through a single integrated system. The matcher uses a unified set of criteria including surface area, orientation, distance from user, and content characteristics to determine optimal placement. This multi-functional approach consolidates what could be multiple specialized systems into one versatile platform, reducing overall system complexity while maintaining comprehensive optimization capabilities.
Data Source
AI summary
Systems, methods, and computer program product for displaying virtual content with a wearable display device that in response to identifying a first change from a first field of view to a second field of view, determines, based at least in part upon attribute(s) or criterion (criteria), first virtual content element(s) and second virtual content element(s) from the set that match to first surface(s) within the first field of view, determines second surface(s) within the second field of view based at least in part upon attribute(s) or criterion (criteria), the second surface(s) matching to the second virtual content element(s), moves the first virtual content element(s) from the first surface(s) to the second surface(s), and maintains the second virtual content element(s) with respect to the first surface(s) while the first field of view has been changed into the second field of view.