Multi-Device AR Virtual Space Consistency via Direct State Transmission

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional augmented reality technologies lack the ability to maintain consistency and share changes in a virtual space across multiple information processing devices, leading to inconsistencies and a lack of unity among users.

Innovation Solution

An information processing system comprising multiple devices that capture images of a real space, set a virtual space, and transmit data on changes in the virtual space, ensuring consistency through a direct communication method without the need for relay devices, using markers to detect position and attitude changes, and allowing for shared enjoyment and unity among users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If multiple information processing devices independently process augmented reality without communication, then each device can operate autonomously, but consistency and unity of the virtual space across devices deteriorates

Engineering Contradiction:
Improveautonomous operationVSAvoidconsistency of virtual space
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

Each information processing device transmits detected virtual space state changes to other devices and receives feedback about their detected changes. This feedback mechanism ensures all devices maintain a consistent understanding of the shared virtual space while allowing autonomous operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces a communication protocol as an intermediary that mediates between independently operating devices. This protocol enables exchange of virtual space state data without requiring centralized control, maintaining both autonomy and consistency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If all devices continuously transmit virtual space state data, then consistency across devices is improved, but communication overhead and energy consumption increases

Engineering Contradiction:
Improveconsistency of virtual spaceVSAvoidcommunication energy
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

Instead of continuous transmission, devices transmit virtual space state changes periodically or event-driven when changes occur. This reduces communication frequency while maintaining consistency, lowering energy consumption compared to continuous transmission.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system extracts and transmits only the essential state change data that is necessary for maintaining consistency, rather than transmitting all possible information. This reduces communication overhead and energy usage while preserving the essential virtual space coherence.

Inventive Principle:
Principle #2Taking out (Extraction)

3Reliability

If a relay device is used to coordinate communication between multiple devices, then consistency is improved, but system complexity increases

Engineering Contradiction:
Improveconsistency of virtual spaceVSAvoidcommunication system structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Each device combines the functions of detecting local virtual space changes, transmitting its own state, and receiving other devices' states into a single integrated system. This eliminates the need for separate relay devices, reducing system complexity while maintaining consistency through direct peer-to-peer communication.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS8970623B2Information processing system, information processing method, information processing device and tangible recoding medium recording information processing program
Publication Date: 2015.03.03 NINTENDO CO LTD
  • US8970623B2 patent drawing
  • US8970623B2 patent drawing
  • US8970623B2 patent drawing

AI summary

An example information processing system which includes a plurality of information processing devices, the respective information processing devices carrying out imaging by an imaging device, wherein the respective information processing devices include: an imaging processing unit to generate a captured image by sequentially capturing images of a real space; a virtual space setting unit to set a virtual space commonly used by another information processing device which captures an image of one of an imaging object that is included in a captured image, and an imaging object, at least a portion of external appearance of which matches the imaging object, based on at least the portion of the imaging object included in the captured image; and a transmission unit to send data relating to change in a state of the virtual space, to the other information processing device, when the change in the state of the virtual space is detected.