Multi-User AR Synchronization via Shared Virtual Coordinate System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) technologies are limited in providing shared AR experiences for multiple users, making it difficult for users in different physical locations to collaborate and communicate effectively, as they struggle to share and synchronize AR content and user interactions across different viewpoints and environments.

Innovation Solution

A method and system for generating multi-user AR content using a shared virtual coordinate system, where each user's position and interactions are mapped within this system, allowing for synchronized AR experiences across different devices, including virtual representations of users and their interactions, and spatial audio to enhance communication and collaboration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a shared virtual coordinate system is implemented to enable multi-user AR experiences, then user collaboration and communication are improved, but system complexity increases

Engineering Contradiction:
Improvemulti-user collaboration capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the complex multi-user AR experience into independent modular components: virtual coordinate system management, user position tracking, audio spatialization processing, and content synchronization. Each component handles a specific aspect of the collaboration, reducing overall system complexity while enabling comprehensive multi-user functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A server acts as an intermediary that centralizes the management of the virtual coordinate system and user positions. The server receives position information from multiple users, maintains the shared spatial context, and distributes synchronized AR content to all participants, simplifying the architecture by centralizing complex coordination functions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If spatial audio with directionality is added to convey user positions, then communication effectiveness is improved, but processing requirements and system complexity increase

Engineering Contradiction:
Improvespatial context informationVSAvoidaudio processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system uses spatial audio parameter changes (directionality, volume, and positional characteristics) to encode user position information. By modifying audio parameters based on virtual coordinate positions, the system conveys spatial context without requiring complex visual overlays or additional communication channels.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If virtual representations of user interactions are generated and transmitted, then collaboration context is improved, but data transmission requirements and system complexity increase

Engineering Contradiction:
Improveinteraction context informationVSAvoidcontent generation complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system creates virtual representations (copies) of user interactions and positions within the shared AR environment. These virtual copies allow other users to observe and understand the context of remote users' actions without requiring the actual users to be physically present, maintaining interaction context through digital replicas.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11494153B2Systems and methods for modifying multi-user augmented reality
Publication Date: 2022.11.08 SHOPIFY INC
  • US11494153B2 patent drawing
  • US11494153B2 patent drawing
  • US11494153B2 patent drawing

AI summary

Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.