Shared AR Scene Composition for Multi-User Video Chat

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video call systems lack the ability for multiple users to share the same augmented reality experience, leading to unengaging interactions.

Innovation Solution

A system that enables two or more users to engage in a video call with a shared AR experience by generating a new AR scene that incorporates modified video feeds from client devices, allowing users to be placed in a common AR environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a shared AR experience is implemented in video calls, then user engagement and experience quality are improved, but system resource usage increases

Engineering Contradiction:
Improveuser engagementVSAvoidsystem resource usage
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent merges multiple video feeds from different users into a single shared AR scene, allowing all participants to experience the same augmented reality environment simultaneously. This combining approach enables collaborative AR experiences while optimizing resource usage by creating one unified scene rather than multiple independent ones.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system creates a universal AR scene that serves all users in the video call simultaneously, making the AR experience multi-functional and shareable. This universal scene can be accessed and interacted with by multiple users, improving engagement while avoiding the resource overhead of creating separate AR instances for each user.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If AR elements are added to video feeds, then user experience is enhanced, but processing complexity increases

Engineering Contradiction:
Improveuser experienceVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary AR scene that acts as a mediator between multiple video feeds and the final composite output. This intermediary layer manages the complexity of integrating AR elements across multiple feeds by providing a centralized processing point, reducing overall system complexity while enhancing user experience.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system segments the video processing into distinct components: individual video feeds, AR element generation, and composite scene assembly. This segmentation allows each component to be processed independently and then integrated, reducing processing complexity while maintaining enhanced user experience through AR elements.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If individual AR experiences are allowed per user, then personalization is improved, but shared interaction is reduced

Engineering Contradiction:
ImprovepersonalizationVSAvoidshared interaction
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent combines multiple individual video feeds into a single shared AR scene where all users participate in the same augmented reality environment. This merging enables shared interaction and collaboration while still allowing each user's video feed to be individually processed and represented within the common scene.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system creates a universal AR scene that serves all users simultaneously, making the experience both shared and interactive. This universal approach allows multiple users to engage with the same AR elements and each other, improving shared interaction while maintaining adaptability through individual video feed integration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12580784B2Shared augmented reality experience in video chat
Publication Date: 2026.03.17 SNAP INC
  • US12580784B2 patent drawing
  • US12580784B2 patent drawing
  • US12580784B2 patent drawing

AI summary

Methods and systems are disclosed for performing operations for providing a shared augmented reality experience in a video chat. A video chat can be established between a plurality of client devices. During the video chat, videos of users associated with the client devices can be displayed. During the video chat, a request from a first client device to activate a first AR experience can be received, and in response, and body parts of users depicted in the videos are modified to include one or more AR elements associated with the first AR experience.