AR Virtual Object Position Stabilization via Distance-Based Noise Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In Augmented Reality (AR) systems, noise in the recognition of object positions leads to fluctuations in the display of virtual objects, causing user displeasure, especially when the virtual objects are farther from a reference point.

Innovation Solution

An information processing device and method that estimate and correct noise effects by adjusting the display of virtual objects based on their distance from a reference point, using a control unit with components like image acquisition, recognition, noise estimation, and display control to stabilize the position and posture of virtual objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the virtual object is displayed farther from the reference point to expand the display area, then the display area is increased, but the position fluctuation due to noise becomes more significant

Engineering Contradiction:
Improvedisplay areaVSAvoidposition accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent applies parameter changes by dynamically adjusting the display parameters (position, size, orientation) of the virtual object based on its distance from the reference point. When the virtual object is far from the reference point, the system modifies display parameters such as reducing size or adjusting position to minimize the impact of noise, thereby maintaining measurement precision while still utilizing the expanded display area effectively.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the virtual object follows the recognized object position precisely to maintain accuracy, then the position accuracy is improved, but the user experience deteriorates due to visible fluctuations caused by noise

Engineering Contradiction:
Improveposition accuracyVSAvoiduser experience
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements beforehand cushioning by pre-establishing compensation mechanisms that counteract the visible fluctuations caused by noise. The system predicts or anticipates the fluctuation effects and applies compensatory adjustments to the virtual object's display parameters in advance, cushioning the user from experiencing disruptive movements while maintaining the underlying accurate position data.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The system employs feedback mechanisms where the display of the virtual object is continuously adjusted based on the recognized object's position and the calculated distance from the reference point. This feedback loop allows the system to maintain position accuracy while dynamically adapting the display to minimize noise-induced fluctuations, thereby improving user experience without sacrificing measurement precision.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP2777026B1Information processing device, information processing method, and program
Publication Date: 2020.02.05 SONY GROUP CORP
  • EP2777026B1 patent drawingFigure 1
  • EP2777026B1 patent drawingFigure 2
  • EP2777026B1 patent drawingFigure 3

AI summary

An apparatus including an image processor configured to receive a video, superimpose an object on the video at a distance from a reference point, and modify a location of the object based on a distance between the object and the reference point in a later frame.