Hybrid AR Content Rendering for Physical Products in Messaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in providing augmented reality experiences for physical products due to computational intensity and graphical bottlenecks, leading to lag and inefficient processing, which affects user immersion and experience.
Innovation Solution
A messaging system that leverages server or remote computing resources to process and render augmented reality content, combined with local processing on client devices, to reduce latency and enhance the presentation of AR content items.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If augmented reality content is processed and rendered using local computing resources on client devices, then the system maintains data privacy and reduces network dependency, but the device experiences computational intensity and graphical bottlenecks leading to lag and inefficient processing
Solution Approach 1:
The patent segments the AR processing workload between client devices and server computing resources. Client devices handle local processing tasks while server resources handle computationally intensive rendering tasks, dividing the system into independent parts that can operate in parallel to improve overall processing efficiency and reduce latency.
Solution Approach 2:
The patent introduces a messaging system as an intermediary between client devices and server computing resources. This intermediary facilitates efficient communication and coordination, enabling seamless collaboration between local and remote processing components to reduce latency while maintaining data privacy.
2Reliability
If more computing resources are allocated to AR rendering, then the quality and immersion of AR experiences improve, but the device complexity and energy consumption increase
Solution Approach 1:
The patent merges local computing resources on client devices with remote server computing resources into a unified hybrid system. This combination allows the system to leverage the strengths of both local processing (data privacy, responsiveness) and cloud processing (computational power, rendering quality) to improve user immersion without significantly increasing device complexity.
Solution Approach 2:
The patent creates a multi-functional system that can dynamically allocate processing tasks between local and remote resources based on requirements. The messaging system serves multiple functions including communication, coordination, and resource management, reducing overall system complexity while enabling high-quality AR rendering.
3Loss of time
If augmented reality content is processed remotely on server systems, then computational bottlenecks are reduced and latency decreases, but network dependency increases and data privacy concerns arise
Solution Approach 1:
The patent segments data handling into different categories: sensitive personal information remains on client devices for local processing, while non-sensitive AR content and rendering data are exchanged with server resources. This segmentation allows remote processing to reduce latency while maintaining data privacy through selective data localization.
Solution Approach 2:
The messaging system acts as a privacy-conscious intermediary that enables secure communication between client devices and server resources. It facilitates necessary data exchange for low-latency AR processing while implementing privacy protection mechanisms to safeguard sensitive information.
Data Source
AI summary
The subject technology selects a set of augmented reality content generators from a plurality of available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for providing augmented reality content based on a product. The subject technology causes display of a carousel interface comprising selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives, at a client device, a selection of a first selectable graphical item from the plurality of selectable graphical items. The subject technology applies, to first image data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology causes a display of second image data, the second image data include including the applied first augmented reality content generator to the first image data.