Augmented Reality Image Selection in Messaging Apps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face inefficiencies in finding the right images to convey specific messages in messaging applications, as they must manually search through multiple pages using keywords, leading to frustration and reduced usage of image-based communication.

Innovation Solution

The system provides an augmented reality experience that allows users to easily locate and select augmented reality items to enhance captured images or videos within messaging applications, with premium experiences available after removing access restrictions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If users manually search through multiple pages using keywords to find images, then they can locate specific images, but the process becomes time-consuming and frustrating

Engineering Contradiction:
Improveimage search accuracyVSAvoidtime to find image
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical search process (typing keywords, navigating pages) with an augmented reality camera-based system. Users point the camera at objects in their environment, and the system automatically identifies and retrieves relevant images, substituting manual search mechanics with automated computer vision and AR technology.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The augmented reality camera acts as an intermediary between the user and the image database. Instead of directly searching through text keywords, the user interacts with the physical world through the camera, which translates real-world objects into digital image queries, facilitating a more natural and efficient search process.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If messaging applications incorporate multiple predetermined graphics, then users have more options, but the complexity of navigating through them increases

Engineering Contradiction:
Improveimage selection optionsVSAvoidinterface complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional scrolling through graphic lists to a three-dimensional augmented reality interface. Images and graphics are overlaid on the real-world view through the camera, allowing users to navigate through options in spatial dimensions rather than linearly through pages, reducing cognitive load and interface complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system automatically presents relevant images and graphics based on what the camera detects in the environment, eliminating the need for users to manually browse through all available options. The application self-curates the most relevant content based on contextual understanding of the scene, reducing interface complexity while maintaining versatility.

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If users navigate through multiple screens and interfaces to select images, then they can access various features, but the number of steps required increases

Engineering Contradiction:
Improvefeature accessVSAvoidnavigation ease
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent merges multiple discrete functions (camera viewing, image search, graphic selection, and messaging) into a single integrated augmented reality interface. All these features are accessible within the camera view without requiring users to navigate between separate screens or interfaces, simplifying the user journey while maintaining full functionality.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary actions by automatically detecting objects, searching for relevant images, and preparing graphic options before the user needs to make selections. This pre-processing occurs in the background while the user simply views the augmented reality overlay, eliminating the need for users to manually initiate each step of the process.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250156047A1Electronic transaction activated augmented reality experiences
Publication Date: 2025.05.15 SNAP INC
  • US20250156047A1 patent drawing
  • US20250156047A1 patent drawing
  • US20250156047A1 patent drawing

AI summary

Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving, by a client device implementing a messaging application, a request to access a display of a plurality of augmented reality experiences; retrieving a plurality of identifiers of each of the plurality of augmented reality experiences; determining that a given augmented reality experience of the plurality of augmented reality experiences is associated with an access restriction; modifying a given identifier of the plurality of identifiers associated with the given augmented reality experience in response to determining that the given augmented reality experience is associated with the access restriction; and generating, for display on the client device, a graphical user interface that includes the plurality of identifiers comprising the modified given identifier.