Messaging-Based AR Product Rendering With Low-Latency Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in providing augmented reality experiences for physical products due to computational intensity and inefficiencies in processing and rendering, leading to lag and frame drops, especially in mixed environments with real and virtual content.
Innovation Solution
A messaging system that leverages server and remote computing resources to process and render augmented reality content, combined with local processing on client devices, to reduce latency and enhance user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If augmented reality content is processed and rendered using local computing resources on client devices, then the system maintains data privacy and reduces network dependency, but the computational intensity causes processing delays, lag, and frame drops
Solution Approach 1:
The patent divides the AR processing workload into segments: local client devices handle user interaction and data privacy requirements, while remote server infrastructure handles computationally intensive rendering and processing tasks. This segmentation allows each component to operate within its optimal performance characteristics, reducing overall latency while maintaining reliability.
Solution Approach 2:
The patent introduces a messaging system as an intermediary layer between client devices and remote servers. This intermediary efficiently manages data transmission, coordinates processing tasks, and synchronizes AR content delivery, thereby reducing network dependency delays while enabling access to remote computing resources.
2Productivity
If augmented reality content is processed using remote server infrastructure, then processing power and rendering capabilities are enhanced, but network dependency increases and data privacy concerns arise
Solution Approach 1:
The patent creates a universal messaging system that can operate in multiple modes: local-only processing for data privacy scenarios, remote server processing for high-performance scenarios, and hybrid modes combining both. This multi-functionality allows the same system architecture to adapt to different requirements without increasing complexity.
Solution Approach 2:
The patent implements preliminary actions by pre-processing AR content on remote servers before transmission to client devices. This includes pre-rendering frames, pre-loading assets, and pre-establishing communication channels, which reduces the computational burden on client devices and minimizes real-time processing delays.
3Power
If computational tasks are distributed across multiple devices, then processing capacity increases, but coordination overhead and synchronization delays increase
Solution Approach 1:
The patent implements feedback mechanisms where the messaging system continuously monitors the performance and status of both local and remote processing components. Based on this feedback, the system dynamically adjusts task distribution, reallocates computational loads, and optimizes synchronization timing, thereby maximizing processing power while minimizing synchronization delays.
Data Source
AI summary
The subject technology selects a set of augmented reality content generators from a plurality of available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for providing augmented reality content based on a product. The subject technology causes display of a carousel interface comprising selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives, at a client device, a selection of a first selectable graphical item from the plurality of selectable graphical items. The subject technology applies, to first image data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology causes a display of second image data, the second image data include including the applied first augmented reality content generator to the first image data.