Robotic Shelf Imaging for Planogram-Based Mis-Stock Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current stock tracking methods struggle to accurately and efficiently monitor the placement and orientation of products on store shelves, leading to inefficiencies in restocking and inventory management.
Innovation Solution
A method utilizing a mobile robotic system to capture images of store shelves, process them using computer vision techniques, and compare them to a database of template images to detect product presence, orientation, and misalignment, generating prompts for restocking or correction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual stock tracking methods are used, then operational simplicity is maintained, but measurement precision and productivity deteriorate
Solution Approach 1:
The patent replaces manual mechanical inspection methods with an automated mobile robotic system equipped with cameras and computer vision algorithms. The robotic system autonomously navigates store shelves, captures images, and uses image processing to detect product placement, orientation, and alignment, thereby substituting human labor with automated optical and computational systems.
Solution Approach 2:
The system enables self-service monitoring by automatically detecting product stock levels, placement accuracy, and orientation without human intervention. The robotic system autonomously performs data collection, analysis, and generates restocking prompts, allowing the inventory management system to serve itself rather than requiring manual tracking personnel.
2Measurement precision
If automated image processing is implemented, then measurement precision improves, but device complexity increases
Solution Approach 1:
The mobile robotic system is designed as a multi-functional platform that performs navigation, image capture, computer vision processing, data analysis, and restocking prompt generation within a single integrated device. This universal system handles multiple tasks (detecting product presence, orientation, alignment, and stock levels) that would otherwise require separate systems, managing complexity through consolidation rather than proliferation of specialized components.
3Productivity
If real-time tracking is implemented, then productivity improves, but use of energy increases
Solution Approach 1:
The system implements periodic monitoring by having the mobile robotic system traverse store shelves at scheduled intervals rather than continuously. The robotic system captures images at discrete time points during its navigation path, processes data periodically, and generates restocking prompts based on accumulated observations. This periodic operation reduces energy consumption compared to continuous real-time monitoring while still providing timely inventory management.
Data Source
AI summary
One variation of a method for tracking placement of products in a store includes: accessing an image recorded by a mobile robotic system within a store; detecting a shelf in a region of the image; based on an address of the shelf, retrieving a list of products assigned to the shelf by a planogram of the store; retrieving a set of template images—from a database of template images—defining visual features of products specified in the list of products; extracting a set of features from the region of the image; determining that a unit of the product is mis-stocked on the shelf in response to deviation between the set of features and features in a template image, in the set of template images, representing the product; and in response to determining that the unit of the product is mis-stocked on the shelf, generating a restocking prompt for the product.