Checkout Camera Image Analysis Sub-Area Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current point-of-sale (POS) systems face high processing loads due to analyzing full images from cameras, which is inefficient for detecting inappropriate actions during sales data processing, as no measures are taken to reduce the volume of image data used for analysis.

Innovation Solution

An information processing device and method that analyze a first sub-area of images from a camera to detect operator or merchandise movement, outputting notifications for non-registration and adjusting the boundary position between sub-areas based on detection frequency, thereby reducing processing load and optimizing image analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the entirety of picked-up images is analyzed to detect inappropriate actions, then detection accuracy is improved, but processing load increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The image analysis is segmented into two distinct areas: a first area where detailed analysis is performed to detect inappropriate actions, and a second area where only movement detection is performed. This segmentation allows the system to maintain high detection accuracy in critical zones while reducing processing load in less critical zones, effectively resolving the contradiction between detection accuracy and processing load.

Inventive Principle:
Principle #1Segmentation

2Productivity

If the volume of image data is reduced to restrain processing load, then processing efficiency is improved, but detection capability may be compromised

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddetection capability
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

Different quality levels of analysis are applied to different regions of the image. The first area receives high-quality detailed analysis to ensure accurate detection of inappropriate actions, while the second area receives lower-quality movement-only analysis. This local differentiation maintains detection capability where needed while improving overall processing efficiency by reducing analysis intensity in other areas.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS20240104929A1Information processing device and information processing method
Publication Date: 2024.03.28 TOSHIBA TEC KK
  • US20240104929A1 patent drawing
  • US20240104929A1 patent drawing
  • US20240104929A1 patent drawing

AI summary

According to one embodiment, an information processing device for analysis of images from a camera positioned to view a checkout apparatus includes a control unit. The control unit is configured to perform an analysis of a first sub-area of images from the camera to detect a movement of an operator or merchandise at the checkout apparatus. The control unit outputs a notification of non-registration if the analysis of the first sub-area of the images indicates that an item of merchandise has arrived at a post-registration storage place of the checkout apparatus from a pre-registration storage place of the checkout apparatus without passing through a registration region. The control unit adjusts a boundary position between the first sub-area and a periphery area in the images from the camera based on how often the operator or the merchandise is detected as crossing the boundary position.