Portable Checkout Unit for Automated Training Data Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional checkout systems in stores are inefficient, leading to long wait times and high costs due to the need for multiple cashiers and the expense of human-labeled training data for automated systems, which can struggle with occlusion and unfamiliar user interfaces.

Innovation Solution

A portable checkout unit generates training data by scanning items and capturing images, creating a virtual shopping list and bounding boxes to identify products, which can be used to train automated checkout systems, reducing development costs and improving efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional cashiers manually scan each item, then checkout accuracy is maintained, but wait time increases and labor costs increase

Engineering Contradiction:
Improvecheckout accuracyVSAvoidwait time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables self-service checkout by automatically identifying products in the shopping cart using computer vision technology. The portable checkout unit with camera captures images of products, and the system automatically generates the shopping list without requiring customer intervention to scan each item manually.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical barcode scanning system with an optical computer vision system. Instead of requiring physical interaction with barcode scanners, the system uses cameras to capture product images and automatically identifies them through image processing and machine learning algorithms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of time

If automated POS systems are deployed, then wait time is reduced, but user interface complexity increases and accessibility decreases

Engineering Contradiction:
Improvewait timeVSAvoiduser interface ease
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The system performs automatic product identification and shopping list generation without requiring customer interaction with complex interfaces. The portable checkout unit autonomously captures images, identifies products, and manages the checkout process, eliminating the need for customers to navigate complicated automated POS interfaces.

Inventive Principle:
Principle #25Self-service

3Productivity

If more cashiers are hired to parallelize checkout, then productivity increases, but labor cost increases

Engineering Contradiction:
Improvecheckout throughputVSAvoidlabor cost
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The automated system performs checkout functions without human cashiers, maintaining high throughput by processing multiple customers simultaneously through the portable checkout unit. The system replaces human labor with autonomous computer vision and processing capabilities.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes the operational parameters from manual cash-based processing to automated image-based identification. This fundamental parameter change enables parallel processing of multiple customers without proportionally increasing labor resources.

Inventive Principle:
Principle #35Parameter changes

4Measurement precision

If human labelers are used to generate training data, then data accuracy is ensured, but development cost increases

Engineering Contradiction:
Improvetraining data accuracyVSAvoiddevelopment cost
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The portable checkout unit automatically generates training data during normal operation by capturing product images and associating them with identified product information. This self-generating approach eliminates the need for expensive human labelers while maintaining data accuracy through the system's automated identification capabilities.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary data collection and labeling during the checkout process itself, preparing training data in advance for future model improvement. This ongoing preliminary action continuously enriches the training dataset without requiring separate expensive labeling campaigns.

Inventive Principle:
Principle #10Preliminary action

5Ease of operation

If cameras on shopping cart are used for automated identification, then ease of operation improves, but measurement precision decreases due to occlusion and insufficient information

Engineering Contradiction:
Improveautomated identificationVSAvoidproduct identification accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The portable checkout unit captures images of products before they become occluded in the shopping cart. By performing preliminary image capture at the point of purchase, the system secures clear product views for accurate identification before the products are hidden among other items in the cart.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses the portable checkout unit as an intermediary to capture product information at the point of purchase, serving as a bridge between the customer and the final shopping cart contents. This intermediary approach ensures clear product images are obtained before occlusion occurs in the cart.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10963740B2Automatic labeling of products via expedited checkout system
Publication Date: 2021.03.30 FOCAL SYSTEMS INC
  • US10963740B2 patent drawing
  • US10963740B2 patent drawing
  • US10963740B2 patent drawing

AI summary

A portable checkout unit automatically generates training data for an automatic checkout system as a customer collects items in a store. A customer uses an item scanner of portable checkout unit to generate a virtual shopping list of items collected in the shopping cart. When the customer adds a new item to the shopping cart or on some regular interval, the portable checkout unit captures images of the items contained by the shopping cart and can generate bounding boxes for each product in each image. The bounding boxes can be associated with item identifiers from previously-generated bounding boxes to identify the items captured by the bounding boxes. Each bounding box paired with an item identifier can then be used as training data for an automated checkout system.