AR Virtual Image Synchronization Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Augmented Reality (AR) technologies lack operability improvements when interacting with images of other apparatuses displayed within a real-space image pickup.

Innovation Solution

An information processing apparatus and method that allows switching between synchronous and asynchronous modes for interacting with virtual images of other apparatuses, enabling intuitive operation by synchronizing or independently changing virtual and real images based on user input and object recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If AR technology is used to operate images on other apparatuses, then user interaction capability is improved, but operability and ease of operation deteriorate due to lack of intuitive control mechanisms

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidoperability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent creates a virtual image that copies the display screen of another apparatus within the AR environment. This virtual image can be operated directly by the user through the image pickup apparatus, providing an intuitive interface that mirrors the actual device being controlled. The copying approach allows users to interact with remote devices through a familiar visual representation rather than abstract controls.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The virtual image serves as an intermediary between the user and the actual display screen of the other apparatus. Instead of directly controlling the remote device through complex protocols, the user interacts with the virtual representation, which then translates these interactions into appropriate control signals. This mediator layer simplifies the interaction model while maintaining full control capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If virtual images are operated independently from real images, then ease of operation is improved, but synchronization and reliability deteriorate

Engineering Contradiction:
Improveindependent operation capabilityVSAvoidsynchronization
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements a dynamic system where the relationship between virtual and real images can change based on operational needs. The virtual image can operate independently when that provides better user experience, while automatically synchronizing with the real image when consistency is required. This dynamic switching allows the system to adapt its behavior to maintain both ease of operation and reliability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the synchronization parameter dynamically based on operational context. When independent operation is beneficial for ease of use, the synchronization parameter is adjusted to allow divergence. When reliability is paramount, the parameter is adjusted to enforce synchronization. This parameter-based control allows flexible balancing of the two competing requirements.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP2832107B1Information processing apparatus, information processing method, and program
Publication Date: 2020.03.04 SONY GROUP CORP
  • EP2832107B1 patent drawingFigure 1(a)~1(b)
  • EP2832107B1 patent drawingFigure 2
  • EP2832107B1 patent drawingFigure 3A

AI summary

An information processing apparatus may include an image receiving unit configured to receive a first image displayed on a display monitor; a display control unit configured to display a second image on a display unit, wherein the second image comprises at least a portion of the first image; and a switching control unit configured to select one of: a synchronous mode and an asynchronous mode. In the synchronous mode, the first image may be synchronized with the second image such that an alteration made to the second image is included in the first image.