AR Virtual Object Synchronization for Multiplayer Scene Consistency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In multiplayer games using augmented reality (AR) technology, it is challenging for users to experience a specific scene in the same manner due to limitations in the viewing angle of head-mounted displays (HMDs) and differences in user movement, making it difficult to control and synchronize the rendering of virtual objects across multiple users.

Innovation Solution

An information processing device that determines the position and orientation of mobile terminals and controls the display of virtual objects, allowing them to start and end motions asynchronously but in a synchronized manner, ensuring each user experiences the scene consistently despite limited viewing angles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Stability of the object's composition

If a rendering camera is forcibly controlled to show specific scenes, then the scene consistency is improved, but the adaptability to user position and orientation deteriorates

Engineering Contradiction:
Improvescene consistencyVSAvoidadaptability to user position
Core Design Contradiction:
Stability of the object's compositionVSAdaptability or versatility

Solution Approach 1:

The system determines in advance whether each user should experience a specific scene by checking if they are at a predetermined position, and prepares the motion start timing and display position information accordingly. This preliminary determination allows the system to provide consistent scenes to users at the same location while adapting to individual positions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides different motion start timings and display positions tailored to each user's specific position and orientation. Users at different locations receive customized display parameters, ensuring each user experiences the scene appropriately for their local context while maintaining overall consistency.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If the viewing angle of HMD is increased to capture characters at all times, then the scene coverage is improved, but the device complexity increases

Engineering Contradiction:
Improveviewing angle coverageVSAvoiddevice complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

Instead of using a fixed wide-angle display, the system dynamically adjusts the display position and timing of virtual objects based on each user's position and orientation. This dynamic adaptation allows the standard viewing angle to effectively cover the necessary scene area without requiring physical changes to the HMD.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes display parameters (position, timing) rather than physical parameters (viewing angle) to achieve comprehensive scene coverage. By adjusting when and where virtual objects appear on the display, the system effectively expands coverage without modifying the HMD hardware.

Inventive Principle:
Principle #35Parameter changes

3Stability of the object's composition

If users are forced to move to specific positions to experience scenes, then the scene consistency is improved, but the ease of operation deteriorates

Engineering Contradiction:
Improvescene consistencyVSAvoidease of operation
Core Design Contradiction:
Stability of the object's compositionVSEase of operation

Solution Approach 1:

Instead of forcing users to move to specific positions, the system inverts the approach by bringing the specific scene to the user's current position through customized display timing and position. Users experience consistent scenes without being required to relocate, maintaining both consistency and ease of operation.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS11854151B2Information processing device, information processing method, and recording medium
Publication Date: 2023.12.26 SONY GROUP CORP
  • US11854151B2 patent drawing
  • US11854151B2 patent drawing
  • US11854151B2 patent drawing

AI summary

This information processing device includes: a control device which determines whether or not a first terminal is in a first position in a real space, controls, on the basis of the determination that the first terminal is in the first position, the first terminal to start superimposing a virtual object according to the first position on the real space, determines whether or not the second terminal different from the first terminal is in the first position, and controls the second terminal to start superimposing the virtual object on the real space, on the basis of the determination that the second terminal is in the first position. The control device executes differently the start of a first operation of the virtual object by the first terminal and the start of a second operation of the virtual object by the second terminal, with respect to at least one among the display start timing and the display start position of the virtual object, and synchronizes the end of the first operation and the end of the second operation.