Self-Service Checkout Fraud Detection via Video Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Self-service checkout systems face challenges in detecting fraud, including inevitable errors and intentional frauds, due to the complexity of managing various commodity products with short lifecycles, which existing methods like weight sensors or AI image recognition struggle to address effectively, especially in large-scale stores.
Innovation Solution
An information processing program and apparatus that acquires video image data to identify the commodity product gripped by a user and compares it with registered product information, using machine learning models to detect abnormal behaviors and generate alerts for fraudulent activities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If weight sensors are installed in each self-service checkout register to detect fraud, then measurement precision is improved, but device complexity and cost increase excessively
Solution Approach 1:
The patent replaces the mechanical weight sensor system with an optical imaging system using cameras and image processing algorithms. Instead of measuring physical weight, the system captures images of commodity products and uses computer vision to identify and verify products, thereby detecting fraud without the high cost and complexity of weight sensors.
Solution Approach 2:
The patent creates a visual copy (image) of the commodity product and compares it with the registered product information. By capturing an image of the product being scanned and analyzing its visual characteristics, the system verifies whether the scanned product matches the actual product, enabling fraud detection through information copying rather than physical measurement.
2Measurement precision
If image recognition AI is used to detect fraudulent acts, then measurement precision is improved, but training data requirements and device complexity increase
Solution Approach 1:
The patent develops a universal image recognition model that can identify multiple types of commodity products across different categories and stores. Instead of training separate AI models for each product type or store, the system uses a single multi-functional model that adapts to various products, thereby reducing training complexity and data requirements while maintaining high detection accuracy.
Solution Approach 2:
The patent changes the approach from extensive supervised training to a more efficient training methodology that uses fewer data samples. By modifying training parameters and using techniques such as transfer learning or few-shot learning, the system achieves high accuracy with reduced training data requirements, making it suitable for environments with limited product variety or short product lifecycles.
3Ease of operation
If traditional fraud detection methods are used at self-service checkout, then ease of operation is maintained, but reliability of fraud detection deteriorates
Solution Approach 1:
The patent implements a self-service fraud detection system where the imaging device automatically captures images and the processing unit automatically analyzes them without requiring user intervention. The system autonomously compares the captured product image with registered information and generates alerts for potential fraud, maintaining ease of operation while significantly improving detection reliability compared to manual verification methods.
Solution Approach 2:
The patent introduces a feedback mechanism where the system continuously monitors the scanning process, compares scanned products with actual products using image analysis, and provides real-time feedback through alerts when discrepancies are detected. This closed-loop feedback system maintains simple operation for users while reliably detecting fraudulent activities by automatically correcting or flagging errors.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An information processing apparatus acquires video image data on a person who is scanning a code of a commodity product to an accounting machine. The information processing apparatus specifies, by analyzing the acquired video image data, the commodity product that has been gripped by the person within a range of an area that is set for the code of the commodity product to be scanned to the accounting machine. The information processing apparatus acquires, by scanning the code of the commodity product by the accounting machine, commodity product information that has been registered to the accounting machine. The information processing apparatus generates, by comparing the acquired commodity product information with the specified commodity product that has been gripped by the person, an alert connected to an abnormality of a behavior of registering the commodity product to the accounting machine.