Eye Tracking Retail Product Identification System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional shopping experiences in retail stores require customers to physically search and retrieve products, which can be cumbersome, especially for handicapped individuals or those with limited mobility, as they need to navigate through large product arrays and handle items.

Innovation Solution

A system comprising cameras positioned along aisles, an image processing control circuit, and a product identification control circuit that analyzes customer eye movements and purchase history to predict intended purchases, allowing products to be added to a virtual cart without physical interaction, with instructions sent to workers or retrieval systems to fetch selected items.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If customers physically navigate through product arrays and handle items to identify products of interest, then product identification accuracy is improved, but ease of operation deteriorates for handicapped individuals

Engineering Contradiction:
Improveproduct identification accuracyVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces the mechanical system of physical product handling with an optical system. Cameras capture images of products in the customer's field of view, and image processing circuits analyze these images to identify products of interest. This substitution eliminates the need for physical contact while maintaining identification accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary system consisting of cameras and image processing circuits that mediate between the customer's visual attention and product identification. The cameras capture the customer's field of view, and the processing circuits determine which products are being viewed, thereby identifying products of interest without direct physical interaction.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If customers physically retrieve and transport products through the retail store, then product selection capability is improved, but productivity deteriorates due to time-consuming manual handling

Engineering Contradiction:
Improveproduct selection capabilityVSAvoidshopping efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent performs preliminary identification of products of interest through image processing before the customer completes their shopping journey. By analyzing the customer's field of view and identifying products they are viewing, the system pre-processes product selection information, reducing the need for manual retrieval and transport of each item.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If traditional manual product retrieval and handling is used, then ease of operation is maintained for able-bodied customers, but productivity deteriorates for handicapped individuals with limited mobility

Engineering Contradiction:
Improveease of operationVSAvoidshopping efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces mechanical product handling with an optical field-of-view analysis system. Cameras and image processing circuits identify products in the customer's view, eliminating the need for physical retrieval and transport, thereby improving productivity for handicapped individuals without compromising ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12165192B2Identifying object of interest for handicapped individuals based on eye movement patterns
Publication Date: 2024.12.10 WALMART APOLLO LLC
  • US12165192B2 patent drawing
  • US12165192B2 patent drawing
  • US12165192B2 patent drawing

AI summary

In some embodiments, apparatuses and methods are provided to support individuals in a retail environment. Some embodiments, provide systems, comprising: a plurality of cameras positioned in a retail store; an image processing control circuit configured to determine a customer field of view; a product identification control circuit configured to identify a set of multiple products within the identified customer field of view, assign a viewing probability to each product without the first customer having to touch the first product; a product selection control circuit configured to determine a purchase probability of the first product; add the first product to a virtual electronic cart when the purchase probability of the first product exceeds a purchase probability threshold; and communicate instructions to control the worker personal computing device to instruct a worker to retrieve the first product.