Shared AR Collaboration Using Surface Projection and Real-Time Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems lack the capability to provide a shared AR experience where multiple users can interact and collaborate in real-time, enhancing the engagement and interactivity of AR environments.

Innovation Solution

A shared AR system that allows multiple users to participate in the same AR session by detecting user positions, projecting graphical properties like paint streams, and enabling users to paint or erase objects within a shared AR interface, with team assignments and scoring based on painted areas, using geo-fencing and user attributes for team allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a shared AR system is implemented to enable real-time collaboration among multiple users, then user engagement and interactivity are enhanced, but system complexity and computational requirements increase

Engineering Contradiction:
Improvecollaborative capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system divides the AR environment into discrete paintable regions or objects, allowing independent processing and management of different collaborative elements. Each user interaction is segmented into specific actions (painting, erasing, modifying) on specific targets, reducing overall system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A server acts as an intermediary between multiple client devices, coordinating user actions, managing shared state, and distributing updates. This centralizes complex coordination logic away from individual devices, enabling collaborative functionality without proportionally increasing device complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If real-time detection and processing of user positions and actions is implemented, then collaboration responsiveness is improved, but processing time and computational load increase

Engineering Contradiction:
Improveresponse speedVSAvoidprocessing time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system pre-processes and caches AR environment data, object definitions, and user profile information before collaborative sessions begin. This preliminary preparation reduces the computational load during real-time interactions, enabling faster response times without excessive processing delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

User positions and environmental data are updated at periodic intervals rather than continuously, balancing real-time responsiveness with processing efficiency. This periodic sampling approach maintains collaboration quality while reducing overall computational requirements.

Inventive Principle:
Principle #19Periodic action

3Adaptability or versatility

If multiple users are allowed to paint and modify the same AR environment simultaneously, then collaborative creativity is enhanced, but conflicts and synchronization issues arise

Engineering Contradiction:
Improvecollaborative creativityVSAvoidsynchronization reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system implements real-time feedback mechanisms where users can see other participants' actions and current environment state immediately. This visual and positional feedback allows users to adapt their actions to avoid conflicts and coordinate their creative efforts, maintaining synchronization reliability while enabling collaborative creativity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Multiple user actions and modifications are merged into a unified AR environment state managed by the server. The system combines individual contributions while maintaining consistency through centralized state management, allowing collaborative creativity without synchronization conflicts.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12567251B2Shared augmented reality system
Publication Date: 2026.03.03 SNAP INC
  • US12567251B2 patent drawing
  • US12567251B2 patent drawing
  • US12567251B2 patent drawing

AI summary

An augmented reality system to perform operations that include: accessing image data at a client device; determining a position of a user of the client device based on the image data; causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device; detecting an intersection of the projection and a surface of an object; generating a request that includes an identification of the portion of the surface of the object at the client device; and presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.