Visual Layering for Mixed Reality Occlusion Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in effectively managing the visual adjacency of physical and virtual objects in collaborative augmented environments, particularly in mixed reality settings where occlusion handling is complex, especially when multiple users interact with both local and remote objects across different locations.
Innovation Solution
A projection-capture system that uses a camera, display, and layering module, along with a controller, to treat physical and virtual objects as logical layers, allowing for the control of visual adjacency by associating and altering the position of these layers based on user input, enabling seamless interaction and collaboration between physical and virtual objects across different locations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If physical objects are not projected onto by projection images (occlusion handling), then the visual realism and depth perception are improved, but the system complexity increases due to requiring layer management and occlusion detection mechanisms
Solution Approach 1:
The system segments the workspace into multiple logical layers (physical layer and virtual layer) that can be independently managed. The layering module assigns each object to a specific layer, enabling systematic control of visual adjacency and occlusion relationships without requiring complex ad-hoc calculations for each object pair.
Solution Approach 2:
The patent introduces a layering module as an intermediary component that mediates between physical objects and projection images. This module automatically determines visual adjacency relationships and controls occlusion handling, simplifying the overall system architecture by centralizing the complexity in a dedicated management component rather than distributing it across multiple subsystems.
2Adaptability or versatility
If multiple users interact with local and remote objects across different locations, then collaboration capability is improved, but the difficulty of detecting and measuring visual relationships increases
Solution Approach 1:
The patent extends the traditional 2D display space by introducing logical layers as a new dimension for organizing objects. This layered approach allows multiple users' objects to be systematically arranged in vertical layers, making visual adjacency relationships easier to detect and manage even in complex multi-user collaborative environments.
Solution Approach 2:
The system continuously monitors and detects the positions of physical objects using cameras, and the layering module uses this feedback to automatically adjust and maintain correct visual adjacency relationships. This real-time feedback mechanism ensures that occlusion handling remains accurate even as users move objects during collaborative interactions.
3Ease of operation
If visual adjacency between layers is controlled dynamically, then ease of operation is improved, but the loss of time for processing and altering layer positions increases
Solution Approach 1:
The system performs preliminary actions by pre-establishing logical layers and assigning objects to appropriate layers before interactions occur. This preparatory organization enables rapid visual adjacency control during actual user interactions, as the layering module only needs to manage relationships within the pre-defined layer structure rather than creating layers dynamically during operations.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A camera identifies a physical object positioned in a workspace. A display displays first digital information into the workspace. A layering module treats the physical object as a first layer in the workspace and treats the first digital information as a second layer in the workspace. A controller controls the visual adjacency of the first and second layers via display of the first digital information.