AR Content Rendering via Server-Side Object Identification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Providing augmented reality experiences for physical products is challenging due to the computational intensity required to identify and process objects in varying conditions, such as changes in image scales, noise, lighting, and geometric distortion, leading to lag and inefficiencies in rendering AR content.
Innovation Solution
A messaging system that leverages server resources to process and render augmented reality content, using image processing operations like filters and overlays, and employs facial recognition and product metadata extraction from physical identification indicators like barcodes to provide immersive AR experiences by combining client and server-side functionalities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If computational processing is performed locally on the client device to identify and process objects in varying conditions, then measurement precision and adaptability are improved, but device complexity and energy consumption increase
Solution Approach 1:
The patent introduces a server as an intermediary between the client device and the AR content delivery system. The server performs the computationally intensive tasks of object identification, image processing, and AR content generation, while the client device only handles capturing images and displaying results. This mediator approach resolves the contradiction by maintaining high measurement precision through sophisticated processing while reducing device complexity on the client side.
Solution Approach 2:
The system segments the AR processing workflow into distinct components: the client device captures images and displays content, while the server performs object identification, image processing, and AR content generation. This segmentation allows each component to be optimized independently, maintaining high accuracy where needed while reducing complexity on resource-constrained devices.
2Speed
If computational processing is performed locally on the client device to process AR content in real-time, then speed and productivity are improved, but use of energy and device complexity increase
Solution Approach 1:
The server acts as an intermediary that performs computationally intensive AR content processing, allowing the client device to display content without performing heavy computations locally. This maintains speed by keeping the processing pipeline efficient while dramatically reducing energy consumption on the client device.
Solution Approach 2:
The patent shifts the processing dimension from local client-side computation to remote server-side computation. By moving the processing workload to a different dimension (the server infrastructure), the system achieves high-speed AR content delivery without the energy constraints of mobile devices.
3Measurement precision
If sophisticated image processing operations are performed to handle varying conditions like noise and lighting, then measurement precision is improved, but loss of time and productivity decrease
Solution Approach 1:
The server performs preliminary action by pre-processing images and pre-generating AR content in advance. Image processing operations for handling varying conditions like noise and lighting are performed before the actual AR content delivery, reducing the time required during the critical user interaction phase while maintaining high identification accuracy.
Solution Approach 2:
The system maintains continuity of useful action by implementing an efficient pipeline where image capture, processing, AR content generation, and delivery occur in a continuous flow. The server processes images and generates AR content continuously, ensuring that sophisticated image processing operations do not create bottlenecks that would increase latency.
Data Source
AI summary
The subject technology determines a level of expertise associated with a user of a messaging system, the level of expertise based at least in part on user activity in a particular product category. The subject technology, based at least in part on the determined level of expertise, selects media content corresponding to a particular product. The subject technology causes display, at a client device, the selected media content related to the particular product.