Camera-Based Planogram Detection for Retail Inventory

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional retail environments face challenges in efficiently managing product inventory and customer transactions, particularly in the absence of cashiers or dedicated self-checkout stands, where accurate tracking of product locations and updates is labor-intensive and prone to human error.

Innovation Solution

Implementing a system of cameras that capture and analyze image data to identify product volumes and locations, generating planogram data to update virtual carts and maintain accurate inventory, using techniques such as 3D product grouping, convex hull computation, and multi-view triangulation to determine product spaces without human intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional manual inventory tracking methods are used, then device complexity is low, but productivity and accuracy are poor

Engineering Contradiction:
Improveinventory tracking efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical inventory tracking with an automated computer vision system using cameras and image processing algorithms. The system captures images of shelves and products, processes them to identify product locations and quantities, and updates inventory records automatically, eliminating the need for manual counting and reducing human error.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system creates a virtual digital copy of the physical store inventory through image capture and processing. By maintaining an updated visual model of product locations and quantities, the system can track inventory changes without physically moving products or requiring manual record-keeping, thus improving productivity while managing complexity through digital representation.

Inventive Principle:
Principle #26Copying

2Productivity

If automated camera-based detection is implemented, then productivity improves, but device complexity increases

Engineering Contradiction:
Improvetransaction processing speedVSAvoidsensor and processing system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the store environment into multiple camera zones and processes images through segmented processing stages: image capture, product identification, location determination, and inventory updates. This segmentation allows the complex task of automated inventory tracking to be broken down into manageable modules, improving productivity while making the overall system more manageable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The camera system serves multiple functions simultaneously: capturing product locations, identifying products, tracking inventory levels, and monitoring shelf arrangement. By making the detection system multi-functional, the patent improves productivity across multiple operational aspects while consolidating complexity into a single integrated system rather than requiring separate specialized systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If manual planogram updates are performed, then device complexity remains low, but measurement precision and reliability deteriorate

Engineering Contradiction:
Improveproduct location accuracyVSAvoidimage processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces manual visual inspection and planogram updates with automated image processing algorithms that precisely detect product locations, orientations, and quantities. The system processes camera images to extract accurate spatial information and automatically updates digital planograms, eliminating human error and improving measurement precision while managing complexity through algorithmic automation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system continuously captures images, processes them to detect product location changes, and provides feedback to update the digital planogram in real-time or near real-time. This feedback mechanism ensures high measurement precision by constantly monitoring and adjusting the digital model to reflect actual store conditions, while the automated nature of feedback processing manages complexity through systematic updates.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11842321B1Image-based detection of planogram product spaces
Publication Date: 2023.12.12 AMAZON TECH INC
  • US11842321B1 patent drawing
  • US11842321B1 patent drawing
  • US11842321B1 patent drawing

AI summary

This disclosure describes techniques for determining product volumes associated with products in a facility. These product volumes may be used to update planogram data associated with a facility, with the planogram data indicating inventory locations within the facility for various types of items supported by product fixtures. The planogram data may be used, in some instances, to update virtual carts of users interacting with the items in the facility.