Visual Recognition and Sensor Fusion Weight Detection System and Method
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems fail to accurately identify the weight of items being picked up by customers in cashier-less retail environments, which is essential for providing a holistic shopping experience.
Innovation Solution
A sensor-fused system combined with visual recognition techniques is deployed to track customer movements, identify items, and measure their weight, using cameras and sensors to facilitate transactions in retail environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If visual-based systems are used to identify items, then item identification capability is improved, but weight measurement capability deteriorates (no weight detection)
Solution Approach 1:
The patent combines visual recognition systems with weight sensor systems into a unified detection system. The visual system identifies items while weight sensors simultaneously measure their mass, merging two separate detection capabilities into one integrated system that captures both information types without requiring separate independent systems.
Solution Approach 2:
The detection system is designed to perform multiple functions simultaneously: visual identification of items, weight measurement, and customer tracking. This multi-functional system eliminates the need for separate specialized systems for each detection task, providing both visual and weight-based detection capabilities within a single unified platform.
2Measurement precision
If sensor-fused system is deployed, then weight measurement capability is improved, but system complexity increases
Solution Approach 1:
The system divides the detection functionality into separate modular components: visual recognition modules, weight sensor modules, and customer tracking modules. Each module operates independently but contributes to the overall system output, allowing for easier maintenance, debugging, and deployment while maintaining measurement precision through coordinated operation of segmented components.
3Productivity
If cashier-less retail system is implemented, then labor cost is reduced, but accuracy of weighed goods accounting deteriorates
Solution Approach 1:
The system continuously monitors and tracks weighed goods through automated sensors that provide real-time feedback on item weight and customer actions. This feedback loop ensures accurate accounting of all weighed items without human intervention, maintaining reliability by automatically recording and verifying each measurement as it occurs during the shopping journey.
Data Source
AI summary
Disclosed are visual recognition and sensor fusion weight detection system and method. An example method includes: tracking, by a sensor system, objects and motions within a selected area of a store; activating, by the sensor system, a first computing device positioned in the selected area in response to detecting a presence of a customer within the selected area: identifying, by the sensor system, the customer and at least one item carried by the customer; transmitting, by the sensor system, identifying information of the customer and the at least one item to a computing server system via a communication network; measuring, by the first computing device, a weight of the at least one item; transmitting, by the first computing device, the weight to the computing server system via the communication network; and generating, by the computing server system, via the communication network, transaction information of the at least one item.