AR Occlusion Detection Using Target-Object Attributes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Augmented-Reality (AR) systems fail to provide a truly immersive experience due to occlusion issues where virtual objects appear in front of real-world objects from certain perspectives, rather than behind them as intended.
Innovation Solution
An occlusion detection system that captures image data, detects attributes of target objects, compares these attributes with a repository, and adjusts AR content based on detected occlusions to ensure realistic placement of virtual objects relative to real-world objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual objects are overlaid on real-world environment in AR systems, then the AR experience is enhanced, but occlusion issues occur where virtual objects appear in front of real objects instead of behind them
Solution Approach 1:
The patent replaces traditional mechanical/visual overlay methods with a depth-based rendering system. It uses depth information from multiple camera views to calculate occlusion relationships and render virtual objects at correct depths, substituting simple 2D overlay with 3D depth-aware positioning. This resolves the contradiction by achieving precise virtual object positioning (manufacturing precision) that enables truly immersive AR experience (adaptability).
Solution Approach 2:
The patent transitions from 2D image overlay to 3D depth-based rendering. By incorporating depth information as a new dimension and rendering virtual objects at different z-depths based on calculated occlusion relationships, the system achieves proper spatial positioning. This dimensional change allows virtual objects to appear behind real objects when appropriate, resolving the positioning accuracy issue while maintaining AR immersion.
2Manufacturing precision
If existing AR systems place virtual objects behind real objects, then occlusion is handled, but the virtual objects simply appear in front from certain perspectives, failing to provide immersive experience
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously monitors depth information from multiple camera views, calculates occlusion relationships, and adjusts virtual object rendering accordingly. This feedback loop ensures that virtual objects are positioned at correct depths based on real-time depth data, resolving the contradiction between placement accuracy and immersive experience by dynamically adapting to different viewing perspectives.
Solution Approach 2:
The patent makes the virtual object rendering dynamic by adjusting their depth and occlusion properties in real-time based on camera views and calculated occlusion relationships. Rather than static positioning, the system dynamically adapts virtual object placement to match the viewer's perspective and the spatial relationship between objects, thereby achieving both accurate placement and immersive experience.
Data Source
AI summary
An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.