Synchronized AR Virtual Object Placement Across Distributed Devices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality technologies only display virtual objects based on detected markers, lacking innovation in presenting these objects in a more engaging manner.

Innovation Solution

An information processing system comprising multiple apparatuses that communicate to synchronize the placement and display of virtual objects across different captured images, allowing for a common virtual space to be generated and displayed on various devices, enhancing user engagement by enabling real-time control and coordination of virtual objects across separate locations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single information processing apparatus displays virtual objects based on detected markers, then the system is simple to operate, but user interest and engagement are limited

Engineering Contradiction:
Improveease of operationVSAvoiduser interest
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system is divided into multiple independent information processing apparatuses (first, second, third, fourth apparatuses) that can operate autonomously while communicating with each other. Each apparatus detects markers independently and displays virtual objects, but they coordinate through communication to create a unified multi-location AR experience, thereby maintaining operational simplicity while enhancing user interest through collaborative functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A communication network acts as an intermediary between the distributed information processing apparatuses, enabling them to share marker detection results and coordinate virtual object placement. This intermediary allows the system to achieve complex multi-location coordination without increasing the operational complexity of individual apparatuses, resolving the contradiction between ease of operation and user interest.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multiple information processing apparatuses are used to display virtual objects across different locations, then user interest is enhanced, but the system complexity increases

Engineering Contradiction:
Improveuser interestVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

Each information processing apparatus is designed with universal functionality to perform marker detection, virtual object rendering, and communication operations. This multi-functionality allows any apparatus to independently handle the complete AR workflow while also collaborating with others, reducing overall system complexity by eliminating the need for specialized components in each apparatus.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent merges the functionality of multiple information processing apparatuses into a unified system where they collectively provide the AR service. By combining their computational resources, communication capabilities, and display functions, the system achieves enhanced user interest through multi-location support while managing complexity through functional integration rather than multiplication.

Inventive Principle:
Principle #5Merging (Combining)

3Device complexity

If virtual objects are placed independently in each captured image, then device complexity is reduced, but the coherence of the virtual environment across different locations deteriorates

Engineering Contradiction:
Improvedevice complexityVSAvoidenvironment coherence
Core Design Contradiction:
Device complexityVSStability of the object's composition

Solution Approach 1:

The information processing apparatuses exchange feedback information about marker positions and virtual object placements through communication. Each apparatus adjusts its virtual object placement based on feedback from other apparatuses, ensuring that the virtual environment maintains coherence across different physical locations while each device independently performs its placement operations.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10022626B2Information processing system, information processing apparatus, storage medium having stored therein information processing program, and information processing method, for performing augmented reality
Publication Date: 2018.07.17 NINTENDO CO LTD
  • US10022626B2 patent drawing
  • US10022626B2 patent drawing
  • US10022626B2 patent drawing

AI summary

First placement information for placing a first virtual object based on a first reference is transmitted, and the first virtual object is displayed in a first captured image based on the first reference and the first placement information. On the other hand, the transmitted first placement information is acquired, and the first virtual object is displayed in a second captured image based on a second reference and the first placement information.