Feature-Level AR Interaction Tracking for Messaging Experiences

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for augmented reality (AR) experiences in messaging applications cannot track interactions with AR experiences on a feature-by-feature basis, providing only general metrics that do not represent the unique attributes and features of each AR experience, leading to difficulties for AR developers in understanding how to improve specific features.

Innovation Solution

The system tracks interactions with specific features selected by AR experience developers across devices and over time, generating interaction data for each feature type and transmitting this data to a remote server for feedback, allowing developers to enhance or improve certain features of the AR experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If general metrics are provided for AR experiences, then system complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidmeasurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the measurement system into two parts: (1) a simplified client-side component that collects basic interaction data, and (2) a server-side component that performs detailed analysis and generates feature-specific metrics. This segmentation allows the client to remain simple while achieving precise measurements through server-side processing of the collected data.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If feature-by-feature tracking is implemented, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvemeasurement precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces a server as an intermediary between the client device and the developer. The client collects interaction data and transmits it to the server, which then processes the data to generate detailed feature-specific metrics. This intermediary approach allows precise measurements without increasing client device complexity, as the computational burden is shifted to the server.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If detailed interaction data is collected, then information completeness is improved, but loss of time increases

Engineering Contradiction:
Improveinformation completenessVSAvoiddata collection time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts only the essential interaction data elements needed for analysis from the complex AR experience environment. By identifying and collecting only relevant events (such as feature interactions, user actions, and experience milestones), the system achieves comprehensive information gathering without the overhead of collecting unnecessary data, thus reducing data collection time while maintaining information completeness.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12348387B2Augmented reality experience event metrics system
Publication Date: 2025.07.01 SNAP INC
  • US12348387B2 patent drawing
  • US12348387B2 patent drawing
  • US12348387B2 patent drawing

AI summary

Methods and systems are disclosed for performing generating AR experiences on a messaging platform. The methods and systems receive, from a client device, a request to access an augmented reality (AR) experience and access a list of event types associated with the AR experience used to generate one or more metrics. The methods and systems determine that an interaction associated with the AR experience corresponds to a first event type of the list of event types and generates interaction data for the first event type representing the interaction. In response to receiving a request to terminate the AR experience, the systems and methods transmit the interaction data to a remote server.