Smart Tote Activity Detection Using Image Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional materials handling facilities require users to manually load and unload items from totes, leading to inefficiencies and increased effort during the checkout process, as users must retrieve items, place them in totes, scan them, and then return them for payment, which slows down the retrieval process.
Innovation Solution
The implementation of 'smart totes' equipped with cameras and processing pipelines that analyze image data to identify items placed into or removed from the tote, allowing for automatic tracking and updating of virtual item listings, enabling users to bypass traditional checkout processes by automatically charging registered accounts.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional manual checkout processes are used, then users can complete transactions, but the process requires significant time and manual effort for loading, scanning, and unloading items
Solution Approach 1:
The tote automatically performs item identification and tracking functions that would otherwise require manual user action. Sensors within the tote detect when items are placed in or removed from the tote, automatically update the virtual item listing, and trigger charging without requiring user intervention at checkout stations.
Solution Approach 2:
Manual mechanical processes (physically carrying items to checkout, manual scanning with barcodes) are replaced by an automated sensor-based system. The tote uses sensors, image processors, and communication interfaces to automatically detect items, identify them, and transmit data, eliminating the need for manual mechanical handling and scanning operations.
2Ease of operation
If manual item scanning and processing is performed, then items can be registered for payment, but the process becomes complex and requires multiple steps
Solution Approach 1:
The checkout function is extracted from centralized checkout stations and distributed to individual totes. Each tote becomes a self-contained processing unit with sensors, image processors, and communication capabilities, eliminating the need for users to travel to and interact with complex checkout infrastructure.
Solution Approach 2:
The tote serves multiple functions: it acts as a container for items, an automated identification system, a communication device, and a charging terminal. This multi-functionality consolidates what would otherwise require separate devices and processes (shopping bag, barcode scanner, point-of-sale system) into a single integrated unit.
3Productivity
If automated sensor systems are implemented in totes, then checkout efficiency improves, but the device complexity and cost increase
Solution Approach 1:
The automated identification system is segmented into distinct functional modules: sensors for detecting items, image processors for analyzing visual data, and communication interfaces for data transmission. This modular segmentation allows each component to be optimized independently and simplifies the overall system architecture, making the complex functionality more manageable and potentially more cost-effective.
Data Source
AI summary
This disclosure is directed to, in part, a processing pipeline for detecting predefined activity using image data, identifying an item-of-interest and a location of the item-of-interest across frames of the image data, determining a trajectory of the item-of-interest, and determining an identifier of the item-of-interest and an action taken with respect to the item-of-interest. The processing pipeline may utilize one or more trained classifiers and, in some instances, additional data to identify items that are placed into or removed from a tote (e.g., basket, cart, or other receptacle) by users in material handling facilities as the users move around the material handling facilities.