Dynamic Occlusion Adjustment for Immersive XR Content
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing extended reality (XR) systems struggle to effectively manage interactions between virtual content and real-world objects, particularly people and pets, during immersive experiences, leading to occlusion issues where virtual content obstructs important physical environment elements.
Innovation Solution
The system uses sensors and machine learning algorithms to detect objects in the physical environment, adjusting the level of occlusion based on object type, location, movement, and interaction with the user, allowing for dynamic control of virtual content presentation to prioritize immersive experiences while maintaining awareness of real-world entities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual content is presented in an immersive XR environment, then immersion quality is improved, but occlusion of real-world objects worsens
Solution Approach 1:
The system dynamically adjusts occlusion levels based on detected object characteristics. Virtual content occlusion is not static but changes in real-time according to the type, location, and behavior of detected real-world objects, allowing the system to adapt between full immersion and real-world awareness modes
Solution Approach 2:
Different occlusion levels are applied to different regions of the field of view based on what is detected in those regions. The system applies selective occlusion where virtual content may obscure real-world objects of interest, while maintaining full occlusion in regions where virtual content should dominate the user's attention
2Adaptability or versatility
If virtual content occludes real-world objects, then immersive experience is improved, but user awareness of physical environment worsens
Solution Approach 1:
The system continuously detects real-world objects and uses this feedback to adjust occlusion levels. When important real-world objects are detected, the system reduces occlusion to maintain user awareness, and when no such objects are present, it increases occlusion to enhance immersion
Solution Approach 2:
Occlusion levels transition dynamically between immersive and awareness modes based on real-time detection results, allowing the system to respond flexibly to changing environmental conditions and user needs
3Productivity
If occlusion level is increased for virtual content, then immersive experience is improved, but interaction with real-world objects worsens
Solution Approach 1:
The system dynamically adjusts occlusion based on the user's interaction state with real-world objects. When interaction is detected or likely, occlusion is reduced to facilitate interaction, and when no interaction is occurring, occlusion is increased to enhance immersion
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods that adjusts content during an immersive experience. For example, an example process may include presenting a representation of a physical environment using content from a sensor located in the physical environment, detecting an object in the physical environment using the sensor, presenting a video, wherein the presented video occludes a portion of the presented representation of the physical environment, presenting a representation of the detected object, and in accordance with determining that the detected object meets a set of criteria, adjusting a level of occlusion of the presented representation of the detected object by the presented video, where the representation of the detected object indicates at least an estimate of a position between the sensor and the detected object, and is at least partially occluded by the presented video.