Real-Time AR Element Synchronization in Messaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing messaging applications face challenges in synchronizing augmented reality (AR) elements in real-time, leading to latency and a poor shared AR experience, especially on resource-constrained devices.
Innovation Solution
The system allows developers to selectively synchronize a subset of AR elements in real-time, using a real-time entity or resource to propagate changes across client devices, while other AR elements can be updated over lower bandwidth connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all AR elements are synchronized in real-time across client devices, then the shared AR experience quality is improved, but the bandwidth consumption and device resource usage increase significantly
Solution Approach 1:
The patent segments AR elements into different categories based on their synchronization requirements. Critical AR elements that require real-time synchronization are separated from non-critical elements that can use lower bandwidth connections. This segmentation allows the system to optimize bandwidth usage by applying different connection strategies to different AR elements, resolving the contradiction between experience quality and resource consumption.
2Reliability
If all AR elements are synchronized in real-time, then the shared AR experience quality is improved, but the device processing power and memory requirements increase
Solution Approach 1:
The system divides AR elements into segments based on their real-time synchronization needs. By processing and synchronizing only critical AR elements in real-time while using lower bandwidth connections for non-critical elements, the patent reduces the processing load and memory requirements on resource-constrained devices while maintaining acceptable shared AR experience quality.
3Loss of energy
If a subset of AR elements is synchronized selectively, then the bandwidth usage is optimized, but the synchronization latency may increase for non-real-time elements
Solution Approach 1:
The patent applies different quality levels of synchronization to different AR elements based on their specific requirements. Critical AR elements receive high-priority real-time synchronization with minimal latency, while non-critical elements use lower bandwidth connections with acceptable latency. This local quality differentiation optimizes overall bandwidth usage while ensuring that time-sensitive AR elements maintain low synchronization latency.
4Reliability
If real-time synchronization is enabled for all AR elements, then the user experience is improved, but the network infrastructure requirements and costs increase
Solution Approach 1:
The patent implements segmentation of AR elements into real-time and non-real-time categories, allowing the network to allocate bandwidth resources efficiently. Critical AR elements that require real-time synchronization consume higher bandwidth resources, while non-critical elements use lower bandwidth connections. This approach improves overall user experience quality while reducing total network bandwidth consumption and infrastructure requirements.
Data Source
AI summary
Methods and systems are disclosed for generating AR experiences on a messaging platform. The methods and systems establish a shared augmented reality (AR) experience across a plurality of client devices and receive, from a first client device of the plurality of client devices, a request to perform a real-time interaction with a given AR element that is presented on displays of the plurality of client devices. In response to receiving the request, the methods and system enable the first client device to perform one or more modifications to the given AR element while preventing a second of the plurality of client devices from performing real-time interactions with the given AR element. The method and system synchronize the one or more modifications of the given AR element performed by the first client device across each of the plurality of client devices in real time.