Virtual Object Boundary Display Control for AR Delay Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies for presenting virtual objects to users often result in delayed and distorted displays, leading to a strong feeling of wrongness and decreased recognizability, which are exacerbated by the presence of real objects and changes in the user's field of view.

Innovation Solution

An information processing device that acquires the position of a virtual object based on a virtual camera's position calculated from recognition results of a real space and controls the display of the virtual object's boundary using features of real objects in the environment, such as shape, motion, and luminance, to reduce the feeling of delay and maintain recognizability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the display of the virtual object is modified to reduce feeling of wrongness, then the feeling of wrongness is reduced, but the recognizability of the virtual object degrades

Engineering Contradiction:
Improvefeeling of wrongnessVSAvoidrecognizability
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent segments the virtual object into multiple regions (first region and second region) with different display characteristics. The first region has display characteristics that reduce the feeling of wrongness, while the second region maintains characteristics that preserve recognizability. This segmentation allows simultaneous optimization of both contradictory requirements in different spatial zones of the same virtual object.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If the virtual object is displayed with high recognizability, then the recognizability is maintained, but the feeling of wrongness increases due to delay

Engineering Contradiction:
ImproverecognizabilityVSAvoidfeeling of wrongness
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent applies local quality by giving different display characteristics to different regions of the virtual object based on their specific functions. The first region uses display characteristics optimized for reducing feeling of wrongness (such as motion blur or temporal smoothing), while the second region uses characteristics optimized for recognizability (such as sharp edges or high contrast). This local differentiation resolves the contradiction by allowing each region to optimize for its primary purpose.

Inventive Principle:
Principle #3Local quality

3Reliability

If the display modifies the virtual object to account for real object features, then the feeling of wrongness is reduced, but the device complexity increases

Engineering Contradiction:
Improvefeeling of wrongnessVSAvoiddisplay control complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by pre-defining multiple sets of display characteristics corresponding to different regions of the virtual object. The display control section simply selects and applies the appropriate pre-defined characteristics based on the current display timing, rather than dynamically calculating optimal characteristics in real-time. This approach reduces computational complexity while still achieving the goal of reducing feeling of wrongness through region-specific display modifications.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11263456B2Virtual object repositioning versus motion of user and perceived or expected delay
Publication Date: 2022.03.01 SONY GROUP CORP
  • US11263456B2 patent drawing
  • US11263456B2 patent drawing
  • US11263456B2 patent drawing

AI summary

Provided is an information processing device that includes a position acquisition section that acquires a position of a virtual object in a real space, having been determined on the basis of a recognition result of a real space corresponding to an image captured by an imaging device, and a display control section that controls display of at least a boundary of the virtual object, on the basis of the position of the virtual object, and a feature of a real object that resides in the real space and is away from the position of the virtual object.