Mixed-Reality Immersion Switching for Physical Object Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to effectively manage undesirable interactions between virtual and physical environments in immersive experiences, often leading to abrupt device removal that disrupts the user experience.

Innovation Solution

An electronic device with an input mechanism allows users to selectively transition between levels of simulated reality immersion by integrating physical and virtual sensory content, using sensors to detect environmental changes and adjust content presentation accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the user is fully immersed in a virtual reality setting, then the immersive experience is enhanced, but the user cannot sense undesirable interactions with physical objects fast enough to avoid them

Engineering Contradiction:
Improveimmersive experienceVSAvoidundesirable interactions with physical objects
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system dynamically adjusts the immersion level based on detected interactions with physical objects. When a physical object is detected within a threshold distance, the system transitions from full virtual reality immersion to a mixed reality state, allowing the user to perceive both virtual and physical environments simultaneously. This dynamic adjustment resolves the contradiction by maintaining high immersion during safe periods while enabling awareness of physical interactions when needed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements a feedback mechanism using sensors (such as ultrasonic or infrared sensors) to detect physical objects in the user's environment. When the sensor detects a physical object within the threshold distance, this feedback triggers a transition in the display mode from full VR to mixed reality. This feedback loop allows the system to respond to environmental conditions and adjust the immersion level accordingly, preventing harmful interactions while maintaining immersive experience.

Inventive Principle:
Principle #23Feedback

2Object-affected harmful factors

If the user abruptly removes the electronic device to avoid undesirable interactions, then the user can sense physical objects, but the user experience is disrupted

Engineering Contradiction:
Improveawareness of physical objectsVSAvoiduser experience continuity
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

Instead of requiring abrupt device removal, the system dynamically adjusts the display content to include both virtual and physical environments. The display transitions from showing only virtual reality content to showing a combination of virtual and captured physical environment content. This dynamic adjustment allows the user to maintain device usage while becoming aware of physical objects, thus avoiding experience disruption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system introduces an intermediary state (mixed reality display) between full virtual immersion and complete physical awareness. Rather than forcing the user to choose between full VR immersion or device removal, the intermediary mixed reality mode allows simultaneous perception of both virtual and physical environments. This intermediary solution resolves the contradiction by providing a middle ground that maintains both immersion and safety awareness.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the system presents only virtual reality content, then the immersive experience is maximized, but the user cannot perceive physical objects in the surrounding environment

Engineering Contradiction:
Improvevirtual reality immersionVSAvoidphysical environment awareness
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system dynamically switches between presenting only virtual reality content and presenting a combination of virtual and physical content based on the detected presence of physical objects. When no physical objects are detected within the threshold distance, the system presents full VR content for maximum immersion. When physical objects are detected, the system transitions to mixed reality content that includes both virtual and physical environment information, thus dynamically balancing immersion with environmental awareness.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameter of content composition from 100% virtual to a mixture of virtual and physical content. By adjusting the proportion of virtual versus physical content in the display based on sensor input, the system can maximize immersion when safe while restoring physical environment awareness when needed. This parameter change resolves the contradiction by making the content composition adaptive rather than fixed.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS12416968B2Techniques for switching between immersion levels
Publication Date: 2025.09.16 APPLE INC
  • US12416968B2 patent drawing
  • US12416968B2 patent drawing
  • US12416968B2 patent drawing

AI summary

In one implementation, a non-transitory computer-readable storage medium stores program instructions computer-executable on one or more processors of an electronic device to perform operations. The operations include presenting, on a display of the electronic device, a simulated reality (SR) environment at a first immersion level, where the first immersion level is associated with a first location of a reality boundary. Using a rotatable input device of the electronic device, input is received representing a request to change the first immersion level to a second immersion level. In accordance with receiving the input, the SR environment is presented at the second immersion level, where the second immersion level is associated with a second location of the reality boundary.