AR Visual Feedback for Real–Virtual Object Spatial Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing AR technologies lack effective methods to provide tactile feedback for virtual objects, making it difficult for users to understand and interact with AR objects due to the absence of a sense of touch.

Innovation Solution

An information processing apparatus and method that acquires spatial relationships between real and virtual objects, generating user feedback that changes based on these relationships, displayed on captured images or the perceived view, to enhance interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If visual feedback is provided only when hand enters operation space region, then operation detection is simplified, but spatial relationship information (depth, distance) cannot be conveyed to user

Engineering Contradiction:

Improveoperation detection complexityVSAvoidspatial relationship information

Core Design Contradiction:

Device complexityVSLoss of information

Solution Approach 1:

The patent implements continuous visual feedback by displaying the hand's position relative to the operation space region boundary regardless of whether the hand is inside or outside the region. This provides ongoing spatial information to the user about their hand's location and distance to the operable area, resolving the information loss while maintaining operational detection capabilities

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent introduces a boundary indicator as an intermediary visual element that mediates between the hand and the operation space region. This indicator displays the spatial relationship (distance and direction) between the hand and the region boundary, conveying depth information without requiring complex operation detection mechanisms

Inventive Principle:

Principle #24Intermediary (Mediator)

2Device complexity

If AR object is displayed without tactile feedback, then system simplicity is maintained, but user understanding and operation of virtual object becomes difficult

Engineering Contradiction:

Improvesystem complexityVSAvoiduser interaction with AR object

Core Design Contradiction:

Device complexityVSEase of operation

Solution Approach 1:

The patent replaces mechanical tactile feedback with visual feedback mechanisms. Since physical contact feedback cannot be provided for virtual objects, the system substitutes tactile sensations with visual indicators that convey spatial relationships and operational states, maintaining system simplicity while improving ease of operation

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent utilizes color changes in the boundary indicator to convey different spatial relationships and operational states. By changing colors based on hand position relative to the operation space region, the system provides intuitive feedback that improves user understanding without adding mechanical complexity

Inventive Principle:

Principle #32Color changes

Data Source

PatentUS20250335022A1Information processing apparatus and information processing method

Publication Date: 2025.10.30 SONY GROUP CORP

AI summary

An information processing apparatus including circuitry that acquires information indicating a spatial relationship between a real object and a virtual object, and initiate generation of a user feedback based on the acquired information, the user feedback being displayed to be augmented to a generated image obtained based on capturing by an imaging device, or augmented to a perceived view of the real world, and wherein a characteristic of the user feedback is changed when the spatial relationship between the real object and the virtual object changes.