Depth Sensor Shelf Stock Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manual checking of price tags and products on shelves in shopping environments is time-consuming and lacks accuracy, affecting customer experience and store sales.

Innovation Solution

An automated system comprising a motorized unit with a locomotion system, camera system, and central computer system that uses computer vision, location awareness, and algorithms to scan shelves, track price tags, and determine inventory levels, integrating edge computing and backend server machine intelligence for precise location identification and stock level estimation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual checking of price tags and products is used, then operational simplicity is maintained, but time consumption increases and accuracy decreases

Engineering Contradiction:
ImproveaccuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical checking process with an automated optical system. A depth sensor (time-of-flight camera) captures 3D images of shelf contents, and a processing system automatically analyzes the depth data to detect product presence, estimate stock levels, and identify price tag locations. This substitution of mechanical manual inspection with optical sensing and computational analysis simultaneously improves accuracy (through precise depth measurement) and reduces time consumption (through automated parallel processing of multiple shelf locations).

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service inventory monitoring by allowing the shelf scanning system to automatically detect and report stock levels without human intervention. The depth sensor autonomously captures 3D data, the processing system automatically analyzes the data to determine product presence and quantity, and the system self-updates inventory records. This automated self-service approach eliminates the need for manual checking while maintaining high accuracy and significantly reducing time consumption.

Inventive Principle:
Principle #25Self-service

2Productivity

If automated scanning systems are implemented, then productivity and accuracy are improved, but device complexity increases

Engineering Contradiction:
Improvescanning speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces complex manual inventory management processes with a streamlined automated system using time-of-flight depth sensors and image processing algorithms. The depth sensor captures 3D spatial information in a single shot, eliminating the need for multiple manual measurements or complex mechanical scanning mechanisms. The processing system uses computational algorithms to automatically interpret depth data, determine product presence, and calculate stock levels, thereby achieving high productivity through software-based automation rather than complex mechanical systems.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system achieves high productivity by changing the measurement parameter from 2D image capture to 3D depth measurement using time-of-flight sensing. This parameter change allows the system to obtain spatial information about product location and quantity in a single capture event, significantly improving scanning speed. The depth data provides direct information about product presence and stock levels without requiring complex mechanical disassembly or multiple measurement steps, thus enhancing productivity while keeping the hardware relatively simple.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If depth sensors and 3D scanning are used, then stock level estimation accuracy is improved, but use of energy and computational resources increases

Engineering Contradiction:
Improvestock level estimation accuracyVSAvoidcomputational energy
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent replaces energy-intensive continuous mechanical scanning with a single-shot time-of-flight depth sensing approach. The depth sensor captures the entire shelf scene in one instantaneous 3D measurement, eliminating the need for continuous scanning or multiple sequential measurements. This substitution reduces computational energy requirements because the system processes a single depth map rather than continuously analyzing multiple frames or performing repeated mechanical scans, while still achieving high stock level estimation accuracy through the rich spatial information contained in the 3D depth data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system applies partial action by selectively analyzing only the relevant portions of the depth data corresponding to product locations, rather than processing the entire 3D scene in full detail. The processing system identifies regions containing products and focuses computational resources on those specific areas for stock level estimation. This selective processing approach reduces overall computational energy consumption while maintaining high accuracy for the critical measurement of product inventory levels.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system significantly reduces time and increases accuracy in scanning shelves, enabling real-time tracking and inventory management, improving customer experience and store operations by automating the process of price tag placement and inventory monitoring.

Implementation Method 1

a depth sensor and a 3D scanner processor configured to capture a 3D scan of the storage area using the depth sensor

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS12014320B2Systems, devices, and methods for estimating stock level with depth sensor
Publication Date: 2024.06.18 WALMART APOLLO LLC
  • US12014320B2 patent drawing
  • US12014320B2 patent drawing
  • US12014320B2 patent drawing

AI summary

Systems, apparatuses, and methods for scanning a shopping space. The system comprises a locomotion system, a 3D scanner system, and a central computer system. The locomotion system of a motorized unit comprises a locomotion controller and a motor. The 3D scanner system comprises a depth sensor and a 3D scanner processor configured to identify a 3D space associated with a storage area, estimate an occupied volume in the 3D space associated with the storage area based on a 3D scan from the depth sensor, and estimate a stock level of the storage area based on the occupied volume. The central computer system comprises a control circuit configured to receive estimated stock levels from the 3D scanner system and update an inventory database based on the estimated stock levels received from the 3D scanner.