Associated Item Identification for Real-Time Multi-Item Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Identifying and tracking multiple items in real-time is computationally intensive and time-consuming, making it incompatible with real-time applications, especially when images include numerous items.
Innovation Solution
A system utilizing cameras and 3D sensors to capture and process images of items on a platform, selecting optimal cameras based on item pose, and employing machine learning to identify and assign items to users without manual scanning, combined with techniques like homography and point cloud data processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional item identification methods are used (comparing features against every item in database), then identification accuracy is maintained, but processing time increases significantly and real-time performance is lost
Solution Approach 1:
The system performs preliminary actions by capturing images of items on the platform before user interaction occurs. The item tracking device captures images using selected cameras and processes them through machine learning models in advance, creating a ready-to-use item database that eliminates the need for real-time scanning during user checkout, thus resolving the time-accuracy tradeoff
Solution Approach 2:
The patent extracts only the necessary visual features from item images using machine learning models, rather than comparing entire feature sets against all database items. This extraction of key identifying features reduces computational complexity while maintaining identification accuracy, enabling faster processing
2Measurement precision
If multiple cameras are used to capture item images, then item identification accuracy improves, but hardware resource requirements and system complexity increase
Solution Approach 1:
The system applies local quality by selecting specific cameras based on the spatial location and pose of items on the platform. Different cameras are chosen depending on which ones provide the best viewing angle for each specific item, rather than using all cameras uniformly. This reduces hardware utilization complexity while maintaining identification accuracy
Solution Approach 2:
The camera selection process is dynamic rather than static. The item tracking device dynamically selects which cameras to use based on real-time item positions and orientations detected by the 3D sensor. This dynamic adaptation allows the system to achieve high identification accuracy with minimal camera usage at any given moment
3Measurement precision
If manual item scanning is required, then item identification accuracy is ensured, but user interaction time increases and system throughput decreases
Solution Approach 1:
The system implements self-service by automatically capturing images of items and using machine learning models to identify them without requiring user intervention. The item tracking device autonomously selects cameras, captures images, processes them through AI models, and assigns items to user accounts, eliminating the manual scanning bottleneck and increasing system throughput while maintaining accuracy
Data Source
AI summary
An item tracking system comprises a plurality of cameras, a memory storing associations between item identifiers of respective items, and a processor configured to capture a plurality of first images of a first item and identify a first item identifier of the first item based on the first images. The processor captures a plurality of second images of a second item, generates cropped image of the second item from each second image, and identifies an item identifier for each cropped image. Based on the associations stored in the memory, the processor determines that an association exists between the first item identifier of the first item and a second item identifier, and assigns the second item identifier to the second item when at least one of the item identifiers corresponding to the cropped images is the second item identifier.