Virtual Object Opacity Adjustment for Real-World Obstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer-generated reality systems face challenges in seamlessly integrating user interactions with virtual and real objects, particularly in determining the user's intent when moving towards obstructed real objects, which affects the user experience and immersion.

Innovation Solution

The system employs sensors and processors to detect user movement and determine whether it is directed towards virtual or real objects, modifying the visual appearance of virtual objects by adjusting opacity or presentation based on the detected intent, allowing users to interact with real objects obscured by virtual ones.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the virtual object is presented to obstruct the real object, then the immersion in the virtual environment is improved, but the user's ability to interact with real objects is reduced

Engineering Contradiction:
Improveimmersion in virtual environmentVSAvoidinteraction with real objects
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system dynamically adjusts the visual appearance of virtual objects based on detected user movement and intent. When the system determines the user is reaching for a real object behind a virtual object, it modifies the virtual object's appearance (e.g., transparency, opacity) to reveal the real object, thereby enabling interaction while maintaining immersion during normal use

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes visual parameters of virtual objects such as transparency and opacity in response to detected user intent. By modifying these parameters dynamically, the system allows users to interact with real objects when needed while maintaining full immersion when the virtual environment should remain dominant

Inventive Principle:
Principle #35Parameter changes

2Reliability

If the system modifies the visual appearance of virtual objects frequently, then the user experience is improved, but the computational complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system uses sensor data to detect user movement and determines user intent as feedback. Based on this feedback, the system selectively modifies virtual object appearance only when the user intent indicates reaching for a real object, avoiding unnecessary computational overhead from continuous modifications

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary detection of user movement and intent determination before modifying virtual object appearance. This preliminary action allows the system to prepare for potential modifications only when necessary, reducing overall computational complexity

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11842449B2Presenting an environment based on user movement
Publication Date: 2023.12.12 APPLE INC
  • US11842449B2 patent drawing
  • US11842449B2 patent drawing
  • US11842449B2 patent drawing

AI summary

In an exemplary process, a computer-generated reality environment comprising a virtual object is presented and user movement that occurs in a physical environment is detected. In response to determining that the detected user movement is toward the virtual object and that the virtual object obstructs a real object from the physical environment, a determination is made whether the detected user movement is directed to the virtual object or the real object. In accordance with a determination that the detected user movement is directed to the real object, a visual appearance of the virtual object is modified, where modifying the visual appearance of the virtual object comprises displaying presenting at least a portion of the real object. In accordance with a determination that the detected user movement is directed to the virtual object, the presentation of the virtual object is maintained to obstruct the real object.