Context-Aware AR Experience Selection for Physical Environment Fit

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users are often unaware of suitable augmented reality (AR) experiences available through messaging clients due to their physical environment lacking required aspects, leading to frustration and missed opportunities for engaging with relevant AR content.

Innovation Solution

An AR experience selection system automatically selects AR experiences based on the physical environment of the user device, using trigger events like co-location or camera scanning to identify suitable AR experiences and generate user interfaces for engagement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If users manually browse available AR experiences, then they can discover AR content, but they may not find suitable experiences due to lack of awareness of environmental requirements

Engineering Contradiction:
ImproveAR experience suitability informationVSAvoidUser interaction complexity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system automatically detects the physical environment using camera scanning and selects appropriate AR experiences without requiring manual user input. The messaging client autonomously determines suitability based on detected objects, locations, or environmental conditions, eliminating the need for users to manually browse or specify preferences.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs environmental scanning and AR experience selection in advance before the user needs to engage with AR content. By pre-determining suitable experiences based on the current physical context, the system prepares and presents appropriate options proactively rather than reactively.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If the system provides all available AR experiences regardless of environment, then users have more choices, but many experiences will be unsuitable for the current physical context

Engineering Contradiction:
ImproveAR experience selection adaptabilityVSAvoidAR experience suitability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system tailors AR experience recommendations to the specific local physical environment detected by the camera. Instead of presenting a uniform list of all available experiences, the system filters and selects experiences that are locally appropriate based on detected objects, locations, or environmental conditions, ensuring high suitability for the immediate context.

Inventive Principle:
Principle #3Local quality

3Ease of operation

If the system requires manual selection of AR experiences, then users have control over choices, but users may not know which experiences are available or suitable

Engineering Contradiction:
ImproveUser interaction simplicityVSAvoidAR experience availability information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system continuously monitors the physical environment through camera scanning and provides real-time feedback by presenting AR experience options that are currently suitable based on detected conditions. This feedback loop ensures users receive relevant information about available experiences without needing to manually search or understand complex availability criteria.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12475655B2Context-based selection of augmented reality experiences
Publication Date: 2025.11.18 SNAP INC
  • US12475655B2 patent drawing
  • US12475655B2 patent drawing
  • US12475655B2 patent drawing

AI summary

The users' experience of engaging with augmented reality (AR) technology that permits users to interact with their environment and with each other is enhanced by automatically selecting an AR experience that is suitable for use given the physical environment of the user. The physical environment of the user is the physical environment of the user's computing device. The physical environment may include objects and/or conditions present in close proximity to the user's computing device, such as other humans, animals, and smart devices.