Self-Checkout Scan Irregularity Detection Using Video Stream Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Self-checkout systems face issues with scan irregularities, such as customers unintentionally missing items or intentionally not scanning products, leading to potential theft and significant losses, requiring a high number of personnel for monitoring.

Innovation Solution

A system that uses real-time video streams from cameras to detect visual scan intervals and process them based on predefined rules to identify valid scan actions, detecting irregularities when items are not scanned and generating alerts on user devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If self-checkout systems are implemented to reduce personnel requirements, then operational cost is reduced, but scan irregularities and theft increase

Engineering Contradiction:
Improveoperational costVSAvoidscan irregularities and theft
Core Design Contradiction:
Loss of energyVSObject-generated harmful factors

Solution Approach 1:

The patent introduces an intermediary monitoring system consisting of video cameras and image processing modules that act as a mediator between the customer and the checkout system. This intermediary automatically detects scan irregularities by analyzing video streams and comparing scanned items with items removed from shelves, thereby reducing theft and scan errors without requiring additional human personnel at checkout counters.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical system of human cashiers with an automated optical detection system. Instead of relying on human operators to monitor and detect scan irregularities, the system uses video cameras, image processing algorithms, and automated rule-based detection to identify mismatches between scanned items and items removed from shelves, thereby eliminating the need for additional personnel while maintaining security.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Object-generated harmful factors

If more personnel are deployed to monitor self-checkout terminals, then scan irregularities and theft are reduced, but operational cost increases

Engineering Contradiction:
Improvescan irregularities and theftVSAvoidoperational cost
Core Design Contradiction:
Object-generated harmful factorsVSLoss of energy

Solution Approach 1:

The patent implements a self-service monitoring system where the checkout terminal automatically detects and monitors scan irregularities without human intervention. The system uses automated image processing and rule-based detection algorithms to identify mismatches between scanned items and items removed from shelves, enabling the system to self-monitor and self-correct for theft and scan errors without requiring additional personnel.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent incorporates a feedback mechanism where the system continuously monitors video streams, processes images, detects scan irregularities, and provides real-time alerts when mismatches are identified. This closed-loop feedback system automatically responds to potential theft or scan errors by notifying appropriate personnel, enabling timely intervention without requiring constant human supervision at each terminal.

Inventive Principle:
Principle #23Feedback

3Device complexity

If traditional scanner-only systems are used, then device complexity is low, but detection accuracy of scan irregularities is insufficient

Engineering Contradiction:
Improvesystem structureVSAvoiddetection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent merges multiple detection functions into a unified system by combining video camera monitoring, image processing capabilities, and scanner data analysis into a single integrated checkout system. The system combines visual detection of items in the scanning zone with automated comparison against scanned item lists, thereby enhancing detection accuracy without requiring separate complex systems for each function.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11100331B2System and method for detecting scan irregularities at self-checkout terminals
Publication Date: 2021.08.24 EVERSEEN LTD
  • US11100331B2 patent drawing
  • US11100331B2 patent drawing
  • US11100331B2 patent drawing

AI summary

A system for detecting a scan irregularity in scanning process during check-out at a retail store, includes an image receiving module for receiving a video stream of a scanning zone, an image processing module for detecting visual scan intervals in image frames of the video stream, and a decision module. The decision module is configured to process each detected visual scan interval, wherein a processed visual scan interval includes a valid scan action, wherein the valid scan action is a user action performed for scanning an item. The decision module is further configured to detect a scan irregularity in the check-out process, wherein the scan irregularity occurs when an item identified for scanning in a processed visual scan interval is absent in a list of scanned items generated by the scanner during corresponding interval, and provide an alert regarding the scan irregularity at a user computing device.