Virtual Object Behavior Update for AR Stability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality systems, the behavior of virtual objects becomes unstable when the physical object they are attached to moves, leading to unnatural displays such as floating or incorrect positioning.

Innovation Solution

An information processing apparatus with a movement determination unit, a target physical object determination unit, a virtual object behavior update unit, and a display control unit that identifies new target physical objects and updates the behavior of virtual objects accordingly, ensuring stable and natural display even when physical objects move.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the virtual object is displayed on the physical object in augmented reality, then the virtual object can be superimposed and visually recognized in the real space, but the behavior of the virtual object becomes unstable when the physical object moves

Engineering Contradiction:
Improvevirtual object display capabilityVSAvoidvirtual object behavior stability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system continuously monitors the position of the physical object and uses this feedback information to dynamically adjust the virtual object's position and behavior. When the physical object moves, the system detects this change and automatically updates the virtual object's target position and behavior parameters, ensuring stable and natural display throughout the movement process

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The virtual object's behavior parameters are made dynamic rather than static. The system adjusts the virtual object's position, target selection, and behavior characteristics in real-time based on the physical object's movement state, allowing the virtual object to adapt its behavior dynamically to maintain stability and natural appearance

Inventive Principle:
Principle #15Dynamics

2Device complexity

If the virtual object maintains its original position when the physical object moves, then the virtual object display remains simple, but the virtual object appears to float unnaturally

Engineering Contradiction:
Improvevirtual object tracking complexityVSAvoidunnatural display effect
Core Design Contradiction:
Device complexityVSObject-generated harmful factors

Solution Approach 1:

The system performs preliminary actions by pre-establishing the relationship between the virtual object and the physical object before movement occurs. When movement is detected, the system has already prepared the necessary behavior parameters and target position information, allowing for smooth and natural transition without complex real-time calculations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary mechanism that acts as a mediator between the physical object's movement and the virtual object's display. This intermediary layer processes the movement information and translates it into appropriate virtual object behavior changes, filtering out the harmful floating effect while maintaining display simplicity

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240386681A1Information processing apparatus, information processing method, and program
Publication Date: 2024.11.21 SONY GROUP CORP
  • US20240386681A1 patent drawing
  • US20240386681A1 patent drawing
  • US20240386681A1 patent drawing

AI summary

An information processing apparatus includes: a movement determination unit configured to determine a movement of a physical object disposed in a real space; a target physical object determination unit configured to determine a new target physical object from among other physical objects in a case where the target physical object that is a target of behavior of a virtual object moves; a virtual object behavior update unit configured to determine behavior of the virtual object in relation to the new target physical object in a case where the new target physical object is determined; and a display control unit configured to display the virtual object in the real space with the determined behavior.