Robot Vision Inventory Mapping Without Planograms
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing inventory monitoring systems in retail and warehouse environments are costly, time-consuming, and require substantial human intervention to build and update planograms, failing to accurately track misplaced, stolen, or damaged products.
Innovation Solution
A multiple camera sensor suite mounted on an autonomous robot that constructs a realogram, an updateable map of product positions, using onboard processing to track inventory without an initial planogram, and includes features for detecting out-of-stock products, estimating product quantities, and identifying product orientations and labels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual monitoring of product inventory and tracking of product position is performed, then accuracy of inventory tracking is improved, but labor cost and time consumption increase
Solution Approach 1:
The patent replaces manual mechanical inventory monitoring with an automated vision-based system. Multiple cameras capture images of shelves and products, while image processing algorithms automatically identify product positions, orientations, and inventory status. This substitution eliminates manual labor while maintaining high tracking accuracy through computer vision technology.
Solution Approach 2:
The system enables self-service inventory monitoring where the camera system and image processing algorithms autonomously track product inventory without human intervention. The system automatically detects product placement, identifies out-of-stock conditions, and provides real-time inventory status, making the inventory monitoring process self-sufficient.
2Manufacturing precision
If planogram-based inventory tracking is implemented, then product placement compliance is improved, but system complexity and initial setup time increase
Solution Approach 1:
The system performs preliminary image capture and processing to build a database of expected product placements and planogram configurations. By pre-processing reference images and establishing baseline product positions before actual monitoring begins, the system simplifies subsequent compliance checks and reduces real-time processing complexity.
Solution Approach 2:
The system creates digital copies of product images and shelf layouts to compare against actual inventory status. By capturing reference images of correct product placements and creating searchable image databases, the system enables automated compliance verification without requiring complex physical planogram structures.
3Area of stationary object
If fixed position cameras are deployed throughout the store, then inventory monitoring coverage is improved, but installation cost and system complexity increase
Solution Approach 1:
The patent employs movable cameras mounted on robots that dynamically navigate through store aisles to capture inventory images. This dynamic approach replaces static fixed-position cameras, allowing the system to achieve comprehensive coverage with fewer cameras while reducing installation complexity and costs. The mobile platform adapts its position to optimize image capture angles and coverage areas.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system for building a product library without requiring a planogram includes an image capture unit operated to provide images of items. Taking data from a shelf label detector and depth map creation unit, a processing module can be used to compare detected shelf labels to a depth map, define a product bounding box, and associate the bounding box with an image provided by the image capture unit to build image descriptors. The system can include one or more autonomous robots for supporting and moving the image capture unit and other components.