Commodity Identification via Camera and Distance Sensor Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing commodity identification methods in self-service retail systems suffer from low processing efficiency and misjudgment of pickup behaviors due to real-time frame-by-frame analysis.
Innovation Solution
A method that utilizes a combination of image information from cameras and distance signals from sensors to determine the start and end frames of a user's pickup behavior, improving efficiency and accuracy by correlating visual and spatial data for precise commodity identification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If commodity detection is performed for each frame of image in real time, then the system can identify commodity pickup behavior, but the processing efficiency is low
Solution Approach 1:
The system performs preliminary actions by using the distance sensor to detect when a user approaches the storage rack before commodity pickup occurs. This triggers the image collection apparatus to capture images only at relevant moments, avoiding continuous frame-by-frame analysis and improving processing efficiency while maintaining reliable pickup behavior identification.
2Reliability
If commodity detection is performed for each frame of image, then pickup behavior can be detected, but misjudgment of pickup behavior occurs
Solution Approach 1:
The distance sensor acts as an intermediary that provides spatial context information about user proximity to the storage rack. By combining this distance information with image analysis, the system can more accurately determine whether a detected object change represents actual commodity pickup behavior, reducing misjudgments that occur with image-only analysis.
3Reliability
If real-time frame-by-frame image analysis is used, then commodity changes can be monitored, but the system complexity increases
Solution Approach 1:
The distance sensor performs preliminary detection of user approach before commodity pickup occurs. This preliminary action triggers the image collection and analysis processes only when necessary, reducing the overall system complexity by avoiding continuous operation of all components while maintaining reliable commodity change monitoring.
Data Source
AI summary
The present application provides a method, an apparatus, a device and a system for processing commodity identification and a storage medium, where the method includes: receiving image information transmitted by a camera apparatus and a distance signal transmitted by a distance sensor corresponding to the camera apparatus; determining a start frame and an end frame for a pickup behavior of a user according to the image information and the distance signal; and determining, according to the start frame and the end frame for the pickup behavior of the user, information of a commodity taken by the user. By performing a commodity identification on the start frame and the end frame for the pickup behavior of the user, and determining the information of the commodity taken by the user, commodity identification efficiency is effectively improved.