Dynamic Virtual Object Visibility Control in Augmented Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality systems, virtual objects are often excessively shielded by real objects, leading to reduced visibility and an uncomfortable user experience, particularly when multiple real objects obscure the virtual object's view.

Innovation Solution

An information processing apparatus and method that dynamically adjust display parameters based on the number of real objects hiding the virtual object, shifting its display position or transmittance to ensure visibility, using different display parameters in first and second states depending on the degree of occlusion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If shielding processing is executed to shield the virtual object by the real object, then depth perception is improved and uncomfortable feeling is reduced, but the virtual object becomes excessively shielded and cannot be viewed

Engineering Contradiction:
Improvedepth perception accuracyVSAvoidvirtual object visibility
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent applies dynamics by making the shielding processing adjustable rather than fixed. The control unit dynamically switches between executing shielding processing and not executing it, based on detected user preferences. This allows the system to adapt the degree of shielding in real-time, resolving the contradiction between maintaining depth perception and ensuring virtual object visibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of shielding intensity by introducing a selectable mode system. Users can choose between different shielding levels (first mode with shielding, second mode without shielding), which changes the display parameter of the virtual object. This parameter change allows the system to balance depth perception requirements against visibility requirements based on user preference.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If the virtual object is displayed with shielding processing, then depth cue is provided to the user, but the virtual object is hidden by real objects and cannot be viewed when positional relationship varies

Engineering Contradiction:
Improvedepth cue accuracyVSAvoidvirtual object visibility
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system dynamically adjusts the shielding behavior based on user-selected modes. When the user selects the second mode, the control unit determines not to execute shielding processing, making the virtual object always visible regardless of positional relationships with real objects. This dynamic adjustment resolves the contradiction between providing depth cues and ensuring ease of viewing.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the display parameter of the virtual object based on the selected mode. In the second mode, the shielding parameter is adjusted to prevent occlusion by real objects, ensuring the virtual object remains visible. This parameter change allows the system to prioritize visibility while still providing depth information through other means.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If shielding processing is always executed, then depth perception is maintained, but user experience becomes uncomfortable when virtual object is excessively hidden

Engineering Contradiction:
Improvedepth perception consistencyVSAvoiduser experience comfort
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent makes the shielding processing dynamic and user-controllable. The control unit switches between executing and not executing shielding processing based on the user's selected mode. This dynamic approach allows users to maintain depth perception when needed (first mode) while avoiding uncomfortable excessive shielding when visibility is prioritized (second mode), thus resolving the contradiction.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates user feedback through mode selection. Users can indicate their preference for shielding behavior, and the control unit adjusts its operation accordingly. This feedback mechanism allows the system to adapt to user needs, resolving the contradiction between maintaining depth perception and ensuring user comfort by allowing users to choose their preferred viewing experience.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11417051B2Information processing apparatus and information processing method to ensure visibility of shielded virtual objects
Publication Date: 2022.08.16 SONY GROUP CORP
  • US11417051B2 patent drawing
  • US11417051B2 patent drawing
  • US11417051B2 patent drawing

AI summary

The present disclosure relates to an information processing apparatus and an information processing method that enable to ensure visibility when a virtual object is shielded. An information processing apparatus is provided that includes a display control unit that controls a display so as to display a virtual object by using a first display parameter in a first state where it is determined that the virtual object displayed by the display is hidden by at least one real object as viewed from a first user of the display and display the virtual object by using a second display parameter different from the first display parameter in a second state where it is determined that the virtual object is hidden by real objects more than that in the first state as viewed from the first user.