Visual Recognition and Weight Sensor Fusion for Cashier-Less Retail
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current visual-based systems in retail environments cannot accurately identify the weight of items being picked up, hindering the implementation of cashier-less retail solutions for weighed goods like produce and deli products.
Innovation Solution
A system combining visual recognition and sensor fusion, where sensors and cameras track objects and motions, activate computing devices to measure item weights, and transmit this information via a communication network to facilitate transactions, enabling accurate weight recording and transaction processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If visual-based systems are used to identify items, then item identification capability is improved, but weight measurement capability deteriorates (cannot accurately identify weight of items being picked up)
Solution Approach 1:
The patent combines visual recognition systems with weight sensor systems into a unified monitoring system. The visual system identifies items being picked up while weight sensors simultaneously measure the weight changes on shelves, creating a comprehensive system that captures both item identification and weight measurement data together.
Solution Approach 2:
The patent introduces computing devices as intermediaries that receive data from both visual recognition systems and weight sensors, process this information, and generate comprehensive item tracking records. These computing devices act as mediators that integrate data from multiple sources to resolve the contradiction between visual identification and weight measurement.
2Measurement precision
If sensor fusion system is implemented to enable weighed goods accounting, then measurement capability is improved, but system complexity deteriorates
Solution Approach 1:
The patent divides the overall monitoring system into distinct functional segments: visual recognition subsystems for item identification, weight sensor subsystems for measurement, and computing devices for data integration. This segmentation allows each component to be optimized independently while maintaining overall system functionality.
Solution Approach 2:
The computing devices in the system serve multiple functions: they receive data from visual recognition systems, process weight sensor data, integrate information from both sources, and generate comprehensive transaction records. This multi-functionality reduces the need for separate dedicated systems for each task.
3Productivity
If cashier-less retail system is implemented, then operational efficiency is improved, but transaction accuracy deteriorates (without proper weight detection)
Solution Approach 1:
The patent implements feedback mechanisms where weight sensors continuously monitor shelf weight changes and visual recognition systems verify item identification. This feedback loop ensures that transaction records are accurately updated based on actual item removal from shelves, maintaining reliability in cashier-less operations.
Solution Approach 2:
The system performs preliminary actions by pre-configuring the integrated monitoring system to automatically detect and record item removals before transactions are finalized. Weight sensors and visual systems continuously monitor and prepare transaction data in advance, ensuring accuracy is maintained throughout the cashier-less shopping process.
Data Source
AI summary
Disclosed are visual recognition and sensor fusion weight detection system and method. An example method includes: tracking, by a sensor system, objects and motions within a selected area of a store; activating, by the sensor system, a first computing device positioned in the selected area in response to detecting a presence of a customer within the selected area; identifying, by the sensor system, the customer and at least one item carried by the customer; transmitting, by the sensor system, identifying information of the customer and the at least one item to a computing server system via a communication network; measuring, by the first computing device, a weight of the at least one item; transmitting, by the first computing device, the weight to the computing server system via the communication network; and generating, by the computing server system, via the communication network, transaction information of the at least one item.