Simulated Reality Content Occlusion Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users immersed in simulated reality (SR) content often appear aloof to others due to occlusion of physical environment objects by SR content, and avatars entering virtual environments may not interact realistically, leading to issues with social interactions and environment immersion.

Innovation Solution

The system adjusts the display of SR content to reduce line-of-sight occlusion of physical environment objects and presents avatars in permissioned and realistic manners within virtual environments by determining interaction criteria, such as spatial and temporal thresholds, and available presentation regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If SR content is displayed to immerse users in simulated reality, then immersion and engagement with virtual content is improved, but occlusion of physical environment objects occurs and social interactions deteriorate

Engineering Contradiction:
Improveimmersion in SR contentVSAvoidocclusion of physical environment objects
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system dynamically adjusts the display of SR content based on detected physical interactions. When a physical interaction is detected, the SR content display is modified to reduce occlusion, allowing users to see physical objects while maintaining SR engagement. This dynamic adaptation resolves the contradiction by making the display state dependent on real-time environmental context.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes display parameters (such as transparency, opacity, or visibility) of SR content in response to detected physical interactions. By adjusting these visual parameters, the system reduces occlusion of physical objects while maintaining SR content delivery, thereby improving both immersion and physical awareness simultaneously.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If SR content occludes physical objects to enhance virtual immersion, then virtual environment engagement is improved, but social interactions and awareness of physical surroundings deteriorate

Engineering Contradiction:
Improvevirtual environment engagementVSAvoidsocial interactions
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system uses feedback from physical interaction detection to control SR content display. When physical interactions (such as hand gestures or movements) are detected, the system provides feedback by adjusting SR content visibility, allowing users to maintain social awareness while engaged in virtual environments. This feedback loop enables seamless transitions between virtual engagement and physical social interaction.

Inventive Principle:
Principle #23Feedback

3Quantity of substance

If avatars are presented in virtual environments without interaction criteria, then virtual environment population is improved, but realistic interaction and environment immersion deteriorate

Engineering Contradiction:
Improveavatar population in virtual environmentVSAvoidrealistic interaction
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The system establishes interaction criteria and presentation region constraints before avatars enter the virtual environment. By pre-defining where and how avatars can be presented based on interaction criteria, the system ensures that avatar population increases while maintaining realistic interaction patterns and environmental immersion.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11836282B2Method and device for surfacing physical environment interactions during simulated reality sessions
Publication Date: 2023.12.05 APPLE INC
  • US11836282B2 patent drawing
  • US11836282B2 patent drawing
  • US11836282B2 patent drawing

AI summary

According to various implementations, a method is performed at an electronic device including one or more processors, non-transitory memory, and one or more displays. The method includes, while presenting a virtual environment, via the one or more displays, obtaining a request for interaction from an external source. The virtual environment includes a first plurality of available presentation regions and a second plurality of unavailable presentation regions. The method includes determining whether the request for interaction from the external source satisfies one or more interaction criteria. The method includes presenting, via the one or more displays, an avatar associated with the external source at one of the first plurality of available presentation regions within the virtual environment, in response to determining that the external source satisfies the one or more interaction criteria.