AR Content Rendering via Server Intermediary for Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in providing augmented reality experiences for physical products, particularly in identifying and rendering accurate AR content that is computationally intensive and prone to latency.
Innovation Solution
A messaging system that leverages server resources to process and render augmented reality content, utilizing product metadata to provide immersive and intuitive AR experiences by identifying physical items through image data and applying relevant AR content to objects such as a user's face.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If augmented reality content is rendered locally on client devices, then AR experiences can be provided, but latency increases and computational resources are overwhelmed
Solution Approach 1:
The patent introduces a server as an intermediary between the client device and AR content generation. The server receives image data from the client, identifies physical items, retrieves corresponding AR content, and sends it back to the client for rendering. This mediator approach distributes computational load, reducing client device overhead and improving response time while maintaining rendering quality.
Solution Approach 2:
The AR content delivery system is segmented into distinct functional components: image data capture on the client device, item identification and content retrieval on the server, and final rendering on the client device. This segmentation allows each component to specialize in specific tasks, improving overall system efficiency and reducing latency compared to performing all operations locally.
2Adaptability or versatility
If computationally intensive AR processing is performed on client devices, then AR content can be generated, but device performance and battery life are negatively impacted
Solution Approach 1:
The server acts as an intermediary that handles computationally intensive tasks including image analysis, item identification, and AR content selection. By offloading these energy-intensive operations to the server, the client device consumes significantly less energy while still accessing diverse and varied AR content, thus maintaining adaptability without the energy cost.
3Speed
If AR content is pre-loaded on client devices, then access speed improves, but storage requirements and device complexity increase
Solution Approach 1:
The system performs preliminary actions on the server side by pre-processing and organizing AR content databases, creating item identification systems, and preparing content for rapid retrieval. When a client device requests AR content, the server has already prepared the necessary data structures and content, enabling fast delivery without requiring the client device to store large amounts of AR content locally, thus maintaining speed while reducing device complexity.
Data Source
AI summary
The subject technology requests a set of augmented reality (AR) content generators based on a group ID, generated by an extension application programming interface (API), using a camera API. The subject technology receives the set of AR content generators. The subject technology provides for display representations of the set of AR content generators in an interface. The subject technology receives a selection of a first AR content generator from the set of AR content generators. The subject technology renders the first AR content generator for display, using the camera API. The subject technology requests metadata for a set of products based on the selected first AR content generator using the extension API. The subject technology receives the metadata from the extension API. The subject technology provides for display the set of representations of products based on the received metadata.