Image Segmentation for Checkout Processing Bottlenecks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for processing image data in sensor-based environments are inefficient, requiring extensive processing of entire images and leading to increased transaction times and resource utilization during checkout processes.

Innovation Solution

Implementing image segmentation and classification techniques within the environment, using visual sensors and AI-driven modules to identify and process only relevant image data associated with specific tasks, such as item identification and transaction verification, thereby streamlining the checkout process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If entire images are processed for item identification and transaction verification, then comprehensive data analysis is achieved, but processing time and resource utilization increase

Engineering Contradiction:
Improveimage data analysis completenessVSAvoidtransaction processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the image processing task into multiple segments: first segmenting the image into regions of interest (such as shopping cart area, shelf area, person area), then further segmenting each region to identify specific items. This hierarchical segmentation allows the system to process only relevant portions of the image rather than the entire image, reducing processing time while maintaining identification accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and processes only the relevant image data corresponding to specific tasks. For item identification, only the shopping cart area and shelf area are extracted and processed. For transaction verification, only specific item regions are extracted. This selective extraction eliminates unnecessary processing of irrelevant image portions, reducing resource utilization and processing time.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If entire images are processed for item identification and transaction verification, then comprehensive data analysis is achieved, but resource utilization increases

Engineering Contradiction:
Improveimage data analysis completenessVSAvoidcomputational resource utilization
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent implements multi-level image segmentation that divides the processing workload into manageable segments. The first level segments the image into functional regions (shopping cart, shelf, person), and the second level segments each region into specific items or objects of interest. This segmentation strategy reduces the total computational load by processing only relevant image portions, thereby reducing energy consumption and resource utilization while maintaining analysis completeness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts only the necessary image data for each specific task rather than processing the entire image. For item identification, only cart and shelf regions are extracted. For transaction verification, only item-specific regions are extracted. This selective extraction significantly reduces computational resource requirements while preserving the completeness of analysis for relevant data.

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If traditional image processing methods are used, then all image data is analyzed, but checkout transaction speed decreases

Engineering Contradiction:
Improvedata processing accuracyVSAvoidcheckout throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent applies hierarchical image segmentation that first divides the image into functional regions (shopping cart area, shelf area, person area, aisle area) and then further segments each region to identify specific items. This segmentation approach enables parallel processing of different regions, increasing processing speed while maintaining accurate identification and verification capabilities, thereby improving checkout throughput.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and processes only the image data relevant to each specific transaction task. By extracting only the shopping cart area for item identification and only specific item regions for verification, the system reduces processing time and increases transaction speed while maintaining data processing accuracy through focused analysis of critical regions.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11455499B2Method, system, and computer program product for image segmentation in a sensor-based environment
Publication Date: 2022.09.27 TOSHIBA GLOBAL COMMERCE SOLUTIONS HLDG
  • US11455499B2 patent drawing
  • US11455499B2 patent drawing
  • US11455499B2 patent drawing

AI summary

Method, computer program product, and system to provide efficient processing of image data representing an environment comprising a plurality of items available for selection by one or more persons are described. The method includes receiving image data from a plurality of visual sensors, segmenting the image data into a plurality of image segments and classifying the data into predefined image categories. The method also includes identifying an image processing task having a predefined association with the first image category and executing the identified image processing task.