Multi-User AR Session Sync for Live Camera Overlay Sharing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing wearable and mobile devices lack effective systems for facilitating real-time, augmented reality-based communication between multiple users, particularly in enhancing user interactions through live camera feeds and virtual content overlays.

Innovation Solution

A system and method for establishing real-time communication links between users using wearable devices with embedded cameras, enabling live camera feeds and augmented reality interactions, where virtual content items can be applied to the real-world environment visible to the user, controlled through configuration interfaces, and limited by session durations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If real-time communication links are established between multiple users with augmented reality content overlays, then user engagement and interaction experiences are improved, but device complexity and processing requirements increase

Engineering Contradiction:
Improveuser engagementVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the augmented reality processing by distributing different functions across multiple devices. The first device captures the live camera feed and processes local AR content, while the second device receives and displays the feed with additional AR overlays. This segmentation allows complex AR interactions to be divided into manageable processing tasks across devices, reducing the burden on any single device while maintaining high user engagement.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a communication link and synchronization mechanism as an intermediary between multiple devices and users. This intermediary coordinates the transmission of live camera feeds, manages AR content distribution, and ensures synchronized display across devices. By acting as a mediator, the system handles the complexity of multi-user AR interactions without requiring each individual device to process all AR content locally.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If configuration interfaces for session duration and privacy controls are implemented, then privacy protection and user control are improved, but ease of operation decreases

Engineering Contradiction:
Improveprivacy protectionVSAvoidoperation simplicity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system implements preliminary action by providing configuration interfaces that allow users to pre-set session duration limits and privacy controls before entering virtual interaction sessions. Users can define maximum session lengths, specify which contacts may join their sessions, and configure content sharing preferences in advance. This preliminary configuration reduces the need for frequent adjustments during sessions while maintaining strong privacy protection and user control.

Inventive Principle:
Principle #10Preliminary action

3Speed

If live camera feeds and augmented reality content are transmitted in real-time, then interaction responsiveness is improved, but use of energy and data transmission increase

Engineering Contradiction:
Improveinteraction responsivenessVSAvoidenergy consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system applies partial action by transmitting only the necessary portions of video and AR content between devices. Rather than transmitting complete high-resolution video streams continuously, the system sends selectively processed video data and AR content at optimized resolutions and frame rates. This partial transmission approach maintains real-time interaction responsiveness while significantly reducing the energy consumption and data transmission requirements compared to transmitting full-quality content continuously.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12627718B2Virtual interaction session to facilitate augmented reality based communication between multiple users
Publication Date: 2026.05.12 SNAP INC
  • US12627718B2 patent drawing
  • US12627718B2 patent drawing
  • US12627718B2 patent drawing

AI summary

Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, method, and user interface to facilitate augmented reality based communication between multiple users over a network. A first user of a first device is enabled to view a real-world environment that is visible to a second user via a second device by causing display, at the first device, of a live camera feed generated at the second device. The live camera feed comprises images of the real-world environment that is visible to the second user. Input data indicative of a selection by the first user of a virtual content item to apply to the real-world environment that is visible to the second user is received. The first device and second device present media objects overlaid on the real-world environment based on the input data.