AR Product Overlays Triggered by User Interest and Location

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to effectively integrate virtual elements with physical environments to enhance user interaction and information management for products, particularly when detecting user interest and location to provide relevant information or actions.

Innovation Solution

An electronic device detects user interest and location to present virtual elements associated with products, such as goods, by using sensors and displays, and performs actions like adding products to a shopping list or displaying purchase locations, utilizing orientation-locked objects in three-dimensional environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual elements are presented in response to detecting user interest and location, then user interaction is enhanced and relevant information is provided, but system complexity increases due to multiple sensors and processing requirements

Engineering Contradiction:
Improveuser interaction enhancementVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the enhancement of user interaction into distinct functional modules: detection module for capturing user interest and location, processing module for determining relevance, and presentation module for displaying virtual elements. This modular segmentation allows each component to be optimized independently while maintaining overall system adaptability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The electronic device integrates multiple functions into a single system: it detects user interest through various input devices, determines location using sensors, processes this information to identify relevant products, and presents virtual elements through displays. This multi-functionality reduces the need for separate specialized devices while enhancing user interaction.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If the system detects user interest and location to provide relevant virtual elements, then information relevance improves, but detection accuracy requirements increase

Engineering Contradiction:
Improveinformation relevanceVSAvoiddetection accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The system employs multiple input devices and sensors to detect user interest and location, using more detection capabilities than strictly necessary. This excessive detection approach ensures that even if some sensors have limited precision, the cumulative data from multiple sources maintains high information relevance through redundant verification.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system continuously monitors user responses to presented virtual elements and uses this feedback to refine its detection algorithms. By analyzing whether users interact with presented elements or dismiss them, the system adjusts its detection parameters to improve both information relevance and detection accuracy over time.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If the electronic device automatically adds products to shopping lists based on detected interest, then user convenience increases, but error potential increases

Engineering Contradiction:
Improveuser convenienceVSAvoiderror potential
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary verification before automatically adding products to shopping lists. It cross-checks detected user interest against multiple criteria including product availability, user preferences, and purchase history, and provides a preview to the user before finalizing the addition. This preliminary action reduces errors while maintaining convenience.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables users to easily review and self-correct automatically generated shopping list entries. Users can access the shopping list, review automatically added items, and make modifications or deletions as needed. This self-service capability maintains the convenience of automatic addition while allowing users to correct any errors.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12555338B2Presenting virtual elements associated with a product in an environment
Publication Date: 2026.02.17 APPLE INC
  • US12555338B2 patent drawing
  • US12555338B2 patent drawing
  • US12555338B2 patent drawing

AI summary

Some examples of the disclosure are directed to systems and methods for performing one or more actions in response to detecting a product in a physical environment. For example, performing the one or more actions include presenting one or more virtual elements in an environment. For example, performing the one or more actions include storing information associated with the product. In some examples, the one or more actions are performed in accordance with one or more criteria being satisfied. For example, the one or more criteria include a criterion that is satisfied when one or more indications of user interest in the product are detected. In some examples, one or more virtual elements are presented in an environment indicating a location of a product within a region of the physical environment. The methods of the disclosure are optionally performed at an electronic device including a head-mounted display.