AR Object Recognition for Real-World State Mirroring

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing augmented reality (AR) techniques primarily focus on deformation and interaction of virtual objects, failing to effectively convey changes in real-world objects, which limits the immersive enhancement of the real world experience for users.

Innovation Solution

An information processing device and method that recognizes real-world objects using three-dimensional data to generate virtual object images, allowing for dynamic state changes and interactions, such as breakage or movement, by distinguishing objects from backgrounds and overlaying AR images in real-time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If AR techniques focus on deformation and interaction of virtual objects, then virtual object functionality is improved, but realism of real world enhancement deteriorates

Engineering Contradiction:

Improvevirtual object functionalityVSAvoidrealism of real world enhancement

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent creates a virtual copy of the real object that mirrors its physical state changes. The recognition unit detects state changes in the real object, and the virtual object is updated to reflect these changes, providing a realistic augmented reality experience while maintaining virtual object functionality

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system continuously monitors the real object's state through the recognition unit and provides feedback by updating the virtual object's appearance and behavior accordingly. This closed-loop feedback mechanism ensures the virtual representation remains synchronized with the real object, enhancing realism

Inventive Principle:

Principle #23Feedback

2Loss of information

If AR techniques overlay virtual information on real space, then information presentation capability is improved, but integration with real objects deteriorates

Engineering Contradiction:

Improveinformation presentation capabilityVSAvoidintegration with real objects

Core Design Contradiction:

Loss of informationVSReliability

Solution Approach 1:

The system performs preliminary recognition and tracking of the real object's state before generating the virtual object overlay. By pre-processing the real object data and anticipating state changes, the system achieves better integration between virtual and real elements

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The recognition unit acts as an intermediary that bridges the real object and the virtual object. It detects state changes in the real object and translates them into corresponding updates for the virtual object, ensuring seamless integration while maintaining information presentation capabilities

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11462028B2Information processing device and information processing method to generate a virtual object image based on change in state of object in real space

Publication Date: 2022.10.04 SONY GROUP CORP

AI summary

To provide an information processing device, an information processing method, and a program that can give a user a stronger impression that a real world is enhanced by using an AR technique. The information processing device includes a recognition unit that recognizes an object included in a real space so as to distinguish the object from a background on the basis of three-dimensional data of the real space in order to generate a virtual object image obtained by changing a state of the object.