Image-Based Fraud Detection for Self-Checkout Mismatch Alerts
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional fraud prevention systems for self-checkout machines require complex data management and installation of new machines, incurring high costs and operational burdens on stores.
Innovation Solution
A fraud detection system that utilizes image acquisition and analysis to associate commodity-picking images with identification information, allowing for real-time comparison of registered and confirmed commodities, and alerts store clerks of mismatches.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional fraud prevention systems use in-store cameras and smart carts to monitor customer behavior and manage commodity information, then fraud detection capability is improved, but device complexity and installation cost increase
Solution Approach 1:
The patent merges the fraud detection function with the existing self-checkout machine, eliminating the need for separate camera systems and smart cart infrastructure. The self-checkout machine integrates image acquisition, commodity recognition, and fraud detection capabilities into a single unified system, reducing overall system complexity while maintaining detection effectiveness.
Solution Approach 2:
The self-checkout machine is designed to perform multiple functions: it serves as both the primary checkout device for customers and the fraud detection system. The image acquisition unit and commodity recognition capabilities are dual-purpose, used for both normal checkout operations and fraudulent behavior detection, thereby avoiding additional hardware installation.
2Reliability
If conventional systems install new machines and infrastructure for fraud detection, then fraud detection capability is improved, but installation cost increases
Solution Approach 1:
The self-checkout machine performs fraud detection autonomously without requiring additional dedicated fraud detection hardware. The system uses its existing image acquisition and data processing capabilities to automatically monitor and detect fraudulent behaviors, eliminating the need for separate machine installations and reducing infrastructure costs.
Solution Approach 2:
The existing self-checkout machine infrastructure is leveraged for dual purposes: normal checkout operations and fraud detection. By making the self-checkout machine universal, the system avoids additional installation costs while maintaining effective fraud detection capabilities.
3Measurement precision
If conventional systems require complicated data management on customer behavior and commodity information, then fraud detection accuracy is improved, but ease of operation deteriorates
Solution Approach 1:
The patent combines customer behavior monitoring and commodity information management into a single integrated process within the self-checkout machine. The image acquisition unit captures customer actions while the commodity recognition unit identifies products, and both data streams are processed together to determine fraud, simplifying data management while maintaining detection accuracy.
Solution Approach 2:
The system implements real-time feedback mechanisms where the self-checkout machine continuously monitors customer actions, compares them against registered commodity information, and immediately identifies discrepancies. This feedback loop enables accurate fraud detection without requiring complex manual data management, as the system automatically processes and analyzes data streams.
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
A camera 10 captures an image of a customer picking a commodity, and transmits the image to a management device 40 (S1). The management device 40 specifies the picked commodity from the received image (S2), and stores the same into purchase-planned commodity data in association with a basket ID assigned to each basket. When the customer has performed checkout with a self-checkout machine 50, the self-checkout machine 50 transmits data of a settled commodity to the management device 40 (S3). The management device 40 stores the received data of the commodity into checkout commodity data in association with the basket ID, and judges matching between the purchase-planned commodity and the checkout commodity (S4). When the result of the judgement is "mismatch", a clerk is notified of this mismatch through a clerk terminal 30 (S5).