AR Occlusion Detection Using Spatial Depth for Virtual Object Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Augmented-Reality (AR) systems fail to provide a truly immersive experience due to occlusion issues, where virtual objects appear in front of real-world objects from certain perspectives, rather than behind them as intended.
Innovation Solution
An occlusion detection system that captures image data, detects attributes of target objects, compares these attributes with a repository, and identifies occlusions by analyzing image features and location data to generate a more realistic AR display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If virtual objects are overlaid on real-world objects in AR, then the AR display is generated, but the virtual objects appear in front of real objects from certain perspectives instead of behind them
Solution Approach 1:
The patent replaces traditional mechanical 2D overlay methods with a 3D spatial rendering system that uses depth information and occlusion detection to properly position virtual objects in three-dimensional space relative to real-world objects, enabling accurate occlusion handling
Solution Approach 2:
The system transitions from two-dimensional image overlay to three-dimensional spatial composition by incorporating depth data and perspective information, allowing virtual objects to be rendered at different depths and properly occluded by real objects based on their spatial relationships
2Device complexity
If existing AR systems simply overlay virtual objects on real-world images, then the system complexity is low, but the occlusion handling is incorrect and immersion is broken
Solution Approach 1:
The system performs preliminary occlusion detection and depth analysis before rendering virtual objects, determining in advance which objects should occlude others based on depth information and spatial relationships, thereby ensuring correct occlusion handling from the outset
Solution Approach 2:
The patent introduces an intermediary occlusion detection module that analyzes spatial relationships between virtual and real objects, using depth data and perspective calculations to determine correct occlusion relationships without requiring complex direct manipulation of the rendering pipeline
Data Source
AI summary
An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.