AR Object Control Using Virtual-Real Surface Relation Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality technologies cannot control the behavior of real objects, limiting feedback to users to visual and auditory methods, and cannot perform physical interactions with the real world.

Innovation Solution

An information processing device that recognizes the physical relation between a real object and a virtual object positioned on the same surface and controls the behavior of the real object based on this relation, enabling more appropriate physical feedback to users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If augmented reality technology displays virtual objects on real objects, then visual feedback to users is improved, but physical feedback capability remains limited

Engineering Contradiction:
Improvefeedback capabilityVSAvoidphysical interaction capability
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent merges virtual objects with real objects by positioning virtual objects on identical surfaces as real objects, enabling the virtual object to represent and control the real object's behavior. This combination allows the system to provide both visual feedback through the virtual object display and physical feedback through the controlled behavior of the real object, thereby resolving the limitation of feedback capability while maintaining physical interaction versatility.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The virtual object serves as an intermediary between the user and the real object. By detecting the physical relation between the virtual object and the real object, the system uses the virtual object as a mediator to transmit control signals that adjust the real object's behavior, enabling physical feedback without direct physical manipulation by the user.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If virtual objects are displayed to represent real object functions, then information presentation is improved, but control over real object behavior is lost

Engineering Contradiction:
Improveinformation presentationVSAvoidreal object control
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system implements a feedback mechanism where the detection unit continuously detects the physical relation between the virtual object and the real object, and the control unit adjusts the real object's behavior based on this detected relation. This closed-loop feedback enables the virtual object to not only present information about the real object but also to control its behavior, simultaneously improving information presentation and maintaining ease of operation.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If physical relation detection between virtual and real objects is implemented, then control precision is improved, but system complexity increases

Engineering Contradiction:
Improvephysical relation detection precisionVSAvoiddetection and control system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system creates a virtual copy of the real object with identical surface positioning. By detecting the physical relation between this virtual copy and the real object, the system achieves precise measurement and control. The virtual object serves as a simplified digital representation that captures the essential physical characteristics of the real object, enabling accurate detection without requiring complex physical sensing equipment.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11262838B2Information processing device and information processing method
Publication Date: 2022.03.01 SONY GROUP CORP
  • US11262838B2 patent drawing
  • US11262838B2 patent drawing
  • US11262838B2 patent drawing

AI summary

Provided is an information processing device that provides feedback to a user. The information processing device includes: a recognition unit that recognizes a physical relation between a real object and a first virtual object positioned on an identical surface and a control unit that controls the behavior of the real object based on the physical relation.