Mixed Reality Region Effects for Real Object Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed reality environments often obscure real content with virtual content, leading to user isolation and difficulty in interacting with the physical environment.
Innovation Solution
An application programming interface (API) applies breakthrough effects to increase the prominence of real content in mixed reality environments based on customizable criteria, allowing real content to be presented with increased visibility when certain conditions are met.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If virtual content is presented in mixed reality environments, then immersive experience is improved, but real content becomes obscured and user interaction with physical environment deteriorates
Solution Approach 1:
The system segments the mixed reality environment into multiple regions with different presentation characteristics. Virtual content is presented with full opacity in non-critical areas while maintaining immersion, whereas regions containing real content that requires user interaction are identified and segmented for special handling. This allows the system to maintain immersive experience in general while preserving interaction capability in specific zones.
Solution Approach 2:
The system applies different presentation qualities to different spatial locations within the mixed reality environment. Instead of uniformly obscuring real content throughout the environment, the system selectively reduces virtual content opacity or removes virtual elements only in regions where real content requires user interaction. This local differentiation resolves the contradiction by maintaining immersion where appropriate while enabling interaction where needed.
2Illumination intensity
If virtual content occludes real content, then visual prominence of virtual elements is improved, but visibility and interaction with real objects deteriorates
Solution Approach 1:
The system dynamically adjusts the presentation of virtual content based on real-time detection of user interactions with real objects. When a real object is detected being interacted with, the system dynamically modifies virtual content opacity or position in that region, reducing occlusion temporarily. This dynamic adaptation allows virtual content to maintain visual prominence during normal display while automatically yielding visibility to real objects during interaction moments.
Solution Approach 2:
The system implements feedback mechanisms that monitor user interactions with real content and use this information to adjust virtual content presentation. Sensors detect when users are reaching for, touching, or manipulating real objects, and this feedback triggers automatic adjustments to virtual content in those regions. The feedback loop ensures that virtual content does not permanently obscure real content, resolving the information loss problem while maintaining virtual element prominence during non-interaction periods.
Data Source
AI summary
In some embodiments, an electronic device presents an M R environment including real content and/or virtual content. In some embodiments, a client application provides an API with a target region of the MR environment, one or more criteria, and a presentation effect. In response to the one or more criteria being satisfied, the electronic device presents the target region of the MR environment with the presentation effect.