Augmented Reality Overlay for Personalized Warehouse Item Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Customers and shoppers face difficulties in finding and selecting items based on personal preferences due to the wide variety of products in warehouses, leading to increased chances of errors and time-consuming evaluation processes.

Innovation Solution

An augmented reality application that receives video data from a client device, detects items within the camera's view, matches customer preferences with item attributes, and generates personalized augmented reality elements to enhance the shopping experience by overlaying relevant information directly on the device's display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a wide variety of items are provided in the warehouse inventory, then customer options and personalization are improved, but item selection difficulty and error rate increase

Engineering Contradiction:
Improvecustomer optionsVSAvoiditem selection
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

An augmented reality overlay system acts as an intermediary between the customer and the wide variety of items in the warehouse. The system detects items via camera, retrieves their attributes, and displays personalized information overlays that guide customers through the complex inventory, making selection easier while preserving the wide variety of options.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The augmented reality overlay uses visual indicators such as colored highlights, icons, and annotations to differentiate items based on customer preferences. This visual encoding system helps customers quickly identify relevant items among many options without having to read and compare all item details manually.

Inventive Principle:
Principle #32Color changes

2Measurement precision

If customers evaluate items based on multiple factors, then selection accuracy is improved, but time consumption increases

Engineering Contradiction:
Improveselection accuracyVSAvoidevaluation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-retrieving and pre-processing item attributes and customer preference data before the customer needs to make a selection. When the customer points the camera at an item, the relevant information is already prepared and displayed immediately, eliminating the need for the customer to manually evaluate multiple factors in real-time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The augmented reality overlay creates a virtual copy of the item information displayed directly in the customer's field of view. This includes copying attributes such as price, nutritional information, and preference matches, allowing customers to review all relevant factors simultaneously without physically handling or searching for each item detail.

Inventive Principle:
Principle #26Copying

3Reliability

If shoppers manually read labels and evaluate items, then accurate selection is achieved, but productivity and shopping speed decrease

Engineering Contradiction:
Improveselection accuracyVSAvoidshopping speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system replaces the mechanical process of manually reading physical labels and evaluating items with an automated computer vision and augmented reality system. The camera captures item images, image recognition algorithms identify the items, and the system automatically retrieves and displays relevant information, substituting manual cognitive and physical processes with automated technological processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The augmented reality system provides self-service by automatically detecting items in the warehouse, retrieving their attributes, and presenting personalized information without requiring customer intervention. The system serves itself by managing the entire information retrieval and display process, freeing the customer to simply follow the visual guides provided.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240312160A1Displaying an augmented reality element that provides a personalized enhanced experience at a warehouse
Publication Date: 2024.09.19 MAPLEBEAR INC
  • US20240312160A1 patent drawing
  • US20240312160A1 patent drawing
  • US20240312160A1 patent drawing

AI summary

An augmented reality application executing on a client device receives video data captured by a camera of the device, in which the video data includes a display area of the device. The application detects a set of items within the display area based on the video data, wherein the set of items is included among an inventory of a warehouse associated with a retailer, and accesses a set of attributes of each item. The application retrieves profile information including a set of preferences associated with a customer of the retailer, matches one or more of the set of preferences with one or more attributes of each item, and generates an augmented reality element based on the matches. The augmented reality element is then displayed, such that it is overlaid onto a portion of the display area based on a location within the display area at which the items are detected.