Virtual Object Tangibility Visualization in Mixed Reality

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users in computer-generated reality environments often struggle to distinguish between virtual and real objects, leading to confusion and potential safety hazards due to the lack of clear visual feedback on object tangibility.

Innovation Solution

Implementing a method that uses sensors to detect the movement of real objects and provides visual feedback by removing or fading out virtual objects when they approach a threshold distance, using a dynamic aperture effect to indicate non-tangibility, thereby enhancing user safety and immersion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual objects are displayed with high realism and immersion in a computer-generated reality environment, then user experience and engagement are improved, but user safety and ability to distinguish virtual from real objects deteriorate

Engineering Contradiction:

Improveimmersion qualityVSAvoidsafety hazard

Core Design Contradiction:

Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies visual differentiation techniques where virtual objects are displayed with distinct visual characteristics (such as color overlays, transparency effects, or boundary indicators) that differentiate them from real objects. This allows users to maintain immersion while clearly identifying virtual elements, thereby resolving the contradiction between immersion quality and safety.

Inventive Principle:

Principle #32Color changes

2Reliability

If visual feedback is provided to indicate tangibility of virtual objects, then user safety is improved, but visual clarity and immersion may deteriorate

Engineering Contradiction:

Improveuser safetyVSAvoidvisual clarity

Core Design Contradiction:

ReliabilityVSLoss of information

Solution Approach 1:

The patent implements selective visual feedback mechanisms that apply tangibility indicators only to virtual objects that pose potential safety concerns or are currently being interacted with. This partial application of visual feedback maintains safety without overwhelming the user with constant visual cues, thus preserving visual clarity and immersion.

Inventive Principle:

Principle #16Partial or excessive action

3Reliability

If the system removes or fades virtual objects when approaching real objects, then user safety is improved, but the continuity and realism of the virtual environment deteriorate

Engineering Contradiction:

Improveuser safetyVSAvoidenvironment continuity

Core Design Contradiction:

ReliabilityVSStability of the object's composition

Solution Approach 1:

The patent employs dynamic visual adjustments where virtual objects adapt their appearance based on proximity to real objects. Instead of completely removing or fading virtual objects, the system dynamically modifies their visual properties (such as transparency, size, or intensity) in response to spatial relationships, maintaining both safety and environmental continuity.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS12148111B2Tangibility visualization of virtual objects within a computer-generated reality environment

Publication Date: 2024.11.19 APPLE INC

AI summary

The present disclosure relates to techniques for providing tangibility visualization of virtual objects within a computer-generated reality (CGR) environment, such as a CGR environment based on virtual reality and/or a CGR environment based on mixed reality. A visual feedback indicating tangibility is provided for a virtual object within a CGR environment that does not correspond to a real, tangible object in the real environment. A visual feedback indicating tangibility is not provided for a virtual representation of a real object within a CGR environment that corresponds to a real, tangible object in the real environment.