AR Virtual Object Display Stability Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

It is challenging to consistently recognize the position or posture of real objects in augmented reality applications due to temporal degradation in accuracy, leading to unstable virtual object displays that can confuse users.

Innovation Solution

An image processing apparatus with a recognition unit, determining unit, and display control unit that assesses the stability of recognition and adjusts the display of virtual objects accordingly, including controlling tracking pace and display attributes such as transparency and sharpness, to maintain accurate alignment with real objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If virtual object position is adjusted to track real object position, then alignment accuracy is improved, but display stability deteriorates due to recognition accuracy degradation

Engineering Contradiction:
Improvealignment accuracyVSAvoiddisplay stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The patent applies dynamics by making the virtual object's tracking behavior adaptive rather than fixed. The system dynamically adjusts the tracking pace based on recognition stability assessment, allowing the virtual object to follow real object position changes when recognition is stable, while reducing tracking responsiveness when recognition becomes unstable. This resolves the contradiction by making the system flexible enough to maintain alignment accuracy during stable recognition while preventing display instability during unstable recognition periods.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by continuously assessing recognition stability and using this assessment to control virtual object display behavior. The system monitors recognition results over time, determines whether recognition is stable or unstable, and adjusts virtual object tracking accordingly. This feedback loop enables the system to maintain high alignment accuracy when recognition is reliable while preventing display instability when recognition degrades, thus resolving the technical contradiction.

Inventive Principle:
Principle #23Feedback

2Speed

If virtual object tracking pace is increased to reduce delay, then responsiveness is improved, but display stability deteriorates due to amplification of recognition errors

Engineering Contradiction:
Improvetracking paceVSAvoiddisplay stability
Core Design Contradiction:
SpeedVSStability of the object's composition

Solution Approach 1:

The patent applies dynamics by making the tracking pace adaptive rather than constant. The system adjusts the tracking pace dynamically based on recognition stability assessment - using faster tracking when recognition is stable to reduce delay, and slower tracking when recognition is unstable to prevent error amplification. This dynamic adjustment resolves the contradiction between responsiveness and display stability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the tracking pace parameter based on recognition stability conditions. When recognition is assessed as stable, the system uses a higher tracking pace parameter to improve responsiveness. When recognition is assessed as unstable, the system reduces the tracking pace parameter to maintain display stability. This parameter adjustment strategy resolves the contradiction between speed and stability.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If virtual object display follows recognition results closely, then alignment accuracy is improved, but user confusion increases due to unsteady display

Engineering Contradiction:
Improvealignment accuracyVSAvoiduser understanding
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent applies dynamics by making the virtual object display behavior adaptive based on recognition stability. When recognition is stable, the virtual object closely follows recognition results to maintain high alignment accuracy. When recognition becomes unstable, the system adjusts display behavior to reduce responsiveness to recognition changes, preventing unsteady display that would confuse users. This dynamic adjustment resolves the contradiction between alignment accuracy and user understanding.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by using recognition stability assessment to control virtual object display behavior. The system monitors recognition quality and adjusts display stability accordingly - maintaining close alignment when recognition is reliable, and reducing display responsiveness when recognition degrades to prevent user confusion. This feedback mechanism resolves the contradiction between precision and ease of operation.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10930083B2Image processing apparatus and display control method
Publication Date: 2021.02.23 SONY GROUP CORP
  • US10930083B2 patent drawing
  • US10930083B2 patent drawing
  • US10930083B2 patent drawing

AI summary

Aspects of the present invention include an apparatus comprising a recognition unit that recognizes a real object in an image. The apparatus may further comprises a determining unit that determines a stability indicator indicating a stability of the recognition, and a display control unit that modifies a display of a virtual object according to the stability indicator.