Feature-Level AR Interaction Tracking for Messaging Experiences
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for augmented reality (AR) experiences in messaging applications cannot track interactions with AR experiences on a feature-by-feature basis, providing only general metrics that do not represent the unique attributes and features of each AR experience, leading to difficulties for AR developers in understanding how to improve specific features.
Innovation Solution
The system tracks interactions with specific features selected by AR experience developers across devices and over time, generating interaction data for each feature type and transmitting this data to a remote server for feedback, allowing developers to enhance or improve certain features of the AR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If general metrics are provided for AR experiences, then system complexity is reduced, but measurement precision deteriorates
Solution Approach 1:
The patent segments the measurement system into two parts: (1) a simplified client-side component that collects basic interaction data, and (2) a server-side component that performs detailed analysis and generates feature-specific metrics. This segmentation allows the client to remain simple while achieving precise measurements through server-side processing of the collected data.
2Measurement precision
If feature-by-feature tracking is implemented, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent introduces a server as an intermediary between the client device and the developer. The client collects interaction data and transmits it to the server, which then processes the data to generate detailed feature-specific metrics. This intermediary approach allows precise measurements without increasing client device complexity, as the computational burden is shifted to the server.
3Loss of information
If detailed interaction data is collected, then information completeness is improved, but loss of time increases
Solution Approach 1:
The patent extracts only the essential interaction data elements needed for analysis from the complex AR experience environment. By identifying and collecting only relevant events (such as feature interactions, user actions, and experience milestones), the system achieves comprehensive information gathering without the overhead of collecting unnecessary data, thus reducing data collection time while maintaining information completeness.
Data Source
AI summary
Methods and systems are disclosed for performing generating AR experiences on a messaging platform. The methods and systems receive, from a client device, a request to access an augmented reality (AR) experience and access a list of event types associated with the AR experience used to generate one or more metrics. The methods and systems determine that an interaction associated with the AR experience corresponds to a first event type of the list of event types and generates interaction data for the first event type representing the interaction. In response to receiving a request to terminate the AR experience, the systems and methods transmit the interaction data to a remote server.


