AR Supplemental Item Listing for In-Store Object Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Consumers may have negative experiences in unfamiliar retail environments due to unawareness of item locations or promotions, leading to frustration and potential loss of business for retailers.

Innovation Solution

An augmented reality element is displayed on a client device, listing supplemental items associated with a detected item, using machine-learning algorithms to identify objects and provide information or selectable options, enhancing user experience and promoting related purchases.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional retail navigation methods are used, then customers can physically move through the store, but customers become frustrated and lose awareness of promotions and related items

Engineering Contradiction:
ImproveAwareness of promotions and related itemsVSAvoidCustomer navigation experience
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent introduces an augmented reality interface as an intermediary between the customer and the retail environment. This interface overlays digital information (promotions, related items, navigation cues) onto the physical view through the camera display, allowing customers to access information without leaving their current location or missing visual cues about supplemental items

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds a digital information dimension to the physical retail space by overlaying augmented reality elements on the camera display. This creates a layered experience where customers see both the physical store environment and digital information simultaneously, preventing information loss while maintaining natural navigation

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If detailed information about all items is provided, then customers have complete awareness, but the interface becomes complex and overwhelming

Engineering Contradiction:
ImproveInformation about supplemental itemsVSAvoidInterface complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies local quality by providing information contextually relevant to the specific item the customer is viewing. The augmented reality interface displays supplemental items and promotions localized to the current field of view, showing only information pertinent to items the customer is actually looking at rather than presenting all possible information universally

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by selectively displaying only certain supplemental items and promotions based on what is relevant to the current item being viewed. The system filters and presents a subset of available information rather than all possible information, reducing interface complexity while maintaining sufficient awareness

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If customers search for items in traditional locations, then they follow logical shopping patterns, but they fail to find items located in unexpected areas

Engineering Contradiction:
ImproveItem location accuracyVSAvoidTime to find items
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements preliminary action by pre-calculating and displaying the actual locations of items within the field of view. The system has already determined where items are located and presents this information proactively through augmented reality, allowing customers to see item locations before physically searching, thus preventing time loss from searching in wrong locations

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250391073A1Displaying an augmented reality element listing supplemental items associated with a detected item
Publication Date: 2025.12.25 MAPLEBEAR INC
  • US20250391073A1 patent drawing
  • US20250391073A1 patent drawing
  • US20250391073A1 patent drawing

AI summary

A client device or an online system communicating with the device receives video data captured by a camera of the device, in which the video data depicts a field of view of a display area of the device. The device/system detects an object within the field of view based on the video data and applies one or more machine-learning algorithms to identify the object as an item available at a source. The device/system accesses item data for items available at the source and selects one or more supplemental items associated with the identified item based on item data for the identified item and each supplemental item. The device/system generates an augmented reality element including a listing of the supplemental item(s), as well as information or a selectable option associated with each supplemental item. The augmented reality element is then displayed in the display area of the device.