Video Flow Line Analysis for Privacy-Safe Shoplifting Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for preventing shoplifting in retail environments, such as those using RFID tags or video monitoring, face challenges related to increased costs and privacy concerns when capturing customer images without permission.

Innovation Solution

An information processing method that acquires flow line information from video data to track customers and associates it with the number of items acquired, allowing for precise determination of item acquisition states without identifying individuals, thereby addressing privacy concerns and reducing monitoring burdens.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a shop clerk or security guard continuously monitors video to detect shoplifting, then fraud detection capability is improved, but labor burden and operational complexity increase

Engineering Contradiction:
Improvefraud detection capabilityVSAvoidmonitoring burden
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs self-monitoring by automatically analyzing video data to extract flow line information and detect shoplifting patterns without requiring continuous human observation. The anomaly detection unit autonomously compares detected flow lines against predefined patterns to identify suspicious behaviors, enabling the system to monitor itself and reduce dependency on manual surveillance.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical human monitoring system with an automated computer-based vision system. The image processing unit and anomaly detection unit use algorithmic analysis of video data to detect shoplifting, substituting human cognitive and physical monitoring efforts with automated computational processes that analyze flow line information and item acquisition patterns.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If RFID tags are attached to all items for tracking, then item tracking precision is improved, but manufacturing cost increases

Engineering Contradiction:
Improveitem tracking precisionVSAvoidmanufacturing cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent extracts the tracking function from physical RFID tags and implements it through visual detection methods. Instead of attaching RFID tags to items, the system uses image processing to detect and track items based on their visual characteristics and movement patterns captured by cameras, thereby eliminating the need for expensive physical tags while maintaining tracking capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system creates a digital representation (flow line information) of item movement and customer behavior patterns instead of using physical RFID tags. By capturing and analyzing video data to generate flow lines that represent customer paths and item acquisitions, the system produces a virtual copy of the tracking information that serves the same purpose without the cost of physical tags.

Inventive Principle:
Principle #26Copying

3Reliability

If captured images of customers are managed for fraud detection, then fraud detection capability is improved, but customer privacy is compromised

Engineering Contradiction:
Improvefraud detection capabilityVSAvoidprivacy infringement
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent extracts only the necessary flow line information from video data while discarding identifiable customer images. The system processes video to generate flow lines representing customer movement patterns and item acquisitions, then deletes or does not store the actual captured images. This extraction approach maintains fraud detection capability through pattern analysis while removing privacy-infringing visual data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces flow line information as an intermediary between video capture and fraud detection analysis. Instead of directly analyzing customer images for fraud detection, the system uses flow lines as an intermediate representation that captures behavioral patterns without containing identifiable personal information. This intermediary layer enables fraud detection while protecting customer privacy by decoupling the detection process from personally identifiable visual data.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11574294B2Information processing method, information processing device, and recording medium
Publication Date: 2023.02.07 NEC CORP
  • US11574294B2 patent drawing
  • US11574294B2 patent drawing
  • US11574294B2 patent drawing

AI summary

An information processing method according to an aspect of the present disclosure includes: acquiring, from a video, flow line information of a customer; detecting that the customer acquires an item; and storing, in a storage, flow line information of the customer and information on a number of items acquired by the customer, in association with each other.