AR Apparatus Preparation Mode for Natural Virtual Object Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In augmented reality applications, the interaction between virtual and real objects appears unnatural when the designated real object is not properly disposed, leading to a deterioration in user experience due to incorrect positioning or absence of real objects, making it difficult to maintain intended interactions and settings.

Innovation Solution

An information processing apparatus and method that includes a preparation mode for supporting the disposition of real objects by displaying information in augmented reality based on prerecorded information about the real objects with which virtual objects interact, and recording disposition result information in a database for normal mode interactions, allowing for accurate placement and handling of real objects to prevent unnatural interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a virtual object performs predetermined interaction without verifying real object disposition, then the interaction can occur without setup, but the interaction looks unnatural and causes a feeling of strangeness

Engineering Contradiction:

Improveease of virtual object interactionVSAvoidnaturalness of interaction

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary verification of real object disposition before enabling virtual object interactions. In the preparation mode, the system checks whether required real objects are present at designated locations using recognition processing. Only after successful verification does the system transition to normal mode where interactions become active, ensuring naturalness while maintaining ease of operation.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms by displaying recognition results and disposition status to users. When real objects are not properly disposed, the system provides visual feedback indicating which objects are missing or misplaced. This feedback loop allows users to correct the disposition before interactions begin, resolving the contradiction between ease of operation and interaction naturalness.

Inventive Principle:

Principle #23Feedback

2Reliability

If the system verifies real object disposition before interactions, then the interaction naturalness is improved, but additional preparation steps are required

Engineering Contradiction:

Improvenaturalness of interactionVSAvoidcomplexity of setup process

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system performs self-verification of real object disposition automatically without requiring manual checking by users. The recognition processing unit autonomously identifies real objects and compares their positions against predetermined disposition requirements. This automation reduces the perceived complexity for users while maintaining high interaction naturalness.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system performs preliminary verification in a dedicated preparation mode before transitioning to normal operation. By separating the verification step from the interaction phase, the system organizes complexity into distinct, manageable stages. Users know exactly what to expect in each mode, reducing the perceived complexity despite the additional verification step.

Inventive Principle:

Principle #10Preliminary action

3Measurement precision

If the system uses prerecorded information about real objects, then the interaction accuracy is improved, but the system requires pre-registration of objects

Engineering Contradiction:

Improveprecision of object positioningVSAvoidease of system setup

Core Design Contradiction:

Measurement precisionVSEase of manufacture

Solution Approach 1:

The system performs preliminary registration of real objects and their interaction parameters during system setup or first use. This prerecording of object information enables precise positioning and interaction accuracy during normal operation. The preliminary action of registration is performed once, after which the system can accurately recognize and interact with objects without requiring repeated manual configuration.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system creates digital copies (prerecorded information) of real objects including their physical characteristics, interaction parameters, and designated positions. These digital copies are stored and used for recognition and interaction control. The copying process captures essential object properties once, enabling precise and consistent interactions without requiring physical objects to be repeatedly measured or manually configured.

Inventive Principle:

Principle #26Copying

Data Source

PatentUS11393177B2Information processing apparatus, information processing method, and program

Publication Date: 2022.07.19 SONY GROUP CORP

AI summary

An information processing apparatus includes a controller (100) that performs: control of displaying information in augmented reality in a preparation mode in which a real object is disposed, the information that supports disposition of the real object on the basis of prerecorded information about the real object with which a virtual object has an interaction; and control of recording disposition result information of the real object in a disposition result information database referred to in a normal mode in which the virtual object that has the interaction with the disposed real object is displayed.