Self-Service Checkout Fraud Detection via Video Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Self-service checkout systems face challenges in detecting fraud, including inevitable errors and intentional frauds, due to the complexity of managing various commodity products with short lifecycles, which existing methods like weight sensors or AI image recognition struggle to address effectively, especially in large-scale stores.

Innovation Solution

An information processing program and apparatus that acquires video image data to identify the commodity product gripped by a user and compares it with registered product information, using machine learning models to detect abnormal behaviors and generate alerts for fraudulent activities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If weight sensors are installed in each self-service checkout register to detect fraud, then measurement precision is improved, but device complexity and cost increase excessively

Engineering Contradiction:
Improvefraud detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical weight sensor system with an optical imaging system using cameras and image processing algorithms. Instead of measuring physical weight, the system captures images of commodity products and uses computer vision to identify and verify products, thereby detecting fraud without the high cost and complexity of weight sensors.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a visual copy (image) of the commodity product and compares it with the registered product information. By capturing an image of the product being scanned and analyzing its visual characteristics, the system verifies whether the scanned product matches the actual product, enabling fraud detection through information copying rather than physical measurement.

Inventive Principle:
Principle #26Copying

2Measurement precision

If image recognition AI is used to detect fraudulent acts, then measurement precision is improved, but training data requirements and device complexity increase

Engineering Contradiction:
Improvefraud detection accuracyVSAvoidAI training complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent develops a universal image recognition model that can identify multiple types of commodity products across different categories and stores. Instead of training separate AI models for each product type or store, the system uses a single multi-functional model that adapts to various products, thereby reducing training complexity and data requirements while maintaining high detection accuracy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent changes the approach from extensive supervised training to a more efficient training methodology that uses fewer data samples. By modifying training parameters and using techniques such as transfer learning or few-shot learning, the system achieves high accuracy with reduced training data requirements, making it suitable for environments with limited product variety or short product lifecycles.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If traditional fraud detection methods are used at self-service checkout, then ease of operation is maintained, but reliability of fraud detection deteriorates

Engineering Contradiction:
Improveuser operation simplicityVSAvoidfraud detection reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements a self-service fraud detection system where the imaging device automatically captures images and the processing unit automatically analyzes them without requiring user intervention. The system autonomously compares the captured product image with registered information and generates alerts for potential fraud, maintaining ease of operation while significantly improving detection reliability compared to manual verification methods.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces a feedback mechanism where the system continuously monitors the scanning process, compares scanned products with actual products using image analysis, and provides real-time feedback through alerts when discrepancies are detected. This closed-loop feedback system maintains simple operation for users while reliably detecting fraudulent activities by automatically correcting or flagging errors.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP4383171A1Information processing program, information processing method, and information processing apparatus
Publication Date: 2024.06.12 FUJITSU LTD
  • EP4383171A1 patent drawingFigure 1
  • EP4383171A1 patent drawingFigure 2
  • EP4383171A1 patent drawingFigure 3

AI summary

An information processing apparatus acquires video image data on a person who is scanning a code of a commodity product to an accounting machine. The information processing apparatus specifies, by analyzing the acquired video image data, the commodity product that has been gripped by the person within a range of an area that is set for the code of the commodity product to be scanned to the accounting machine. The information processing apparatus acquires, by scanning the code of the commodity product by the accounting machine, commodity product information that has been registered to the accounting machine. The information processing apparatus generates, by comparing the acquired commodity product information with the specified commodity product that has been gripped by the person, an alert connected to an abnormality of a behavior of registering the commodity product to the accounting machine.