Shopping Basket Image Overlay for Accurate POS Commodity Registration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In retail transaction systems, customers may perform erroneous commodity registrations unnoticed due to improper operations, which can go undetected by both the customer and store clerks.

Innovation Solution

An information processing apparatus and method that uses a cart terminal equipped with a camera to image the shopping basket, detect commodities, and superimpose augmented reality tags with commodity information on the basket image if the detection is followed by a timely registration, ensuring accurate registration and preventing errors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If customers perform commodity registration operations using information communication terminals, then transaction processing can be performed at any place in the store, but erroneous operations may go unnoticed by both customers and store clerks

Engineering Contradiction:
Improvetransaction processing accessibilityVSAvoidcommodity registration accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system captures images of commodities in the shopping basket using a camera, detects the commodities automatically, and displays the detected commodity information on the terminal screen. This visual feedback allows customers to confirm whether their registration operations are correct, and enables store clerks to monitor for erroneous operations. The feedback mechanism directly addresses the reliability issue by providing real-time verification of registration accuracy.

Inventive Principle:
Principle #23Feedback

2Reliability

If store clerks monitor commodity registration operations, then erroneous operations can be detected, but the system complexity and monitoring burden increase

Engineering Contradiction:
Improvecommodity registration accuracyVSAvoidmonitoring system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system enables self-service monitoring by automatically capturing images of the shopping basket, detecting commodities using image processing, and displaying the detected information on the terminal. This automated self-service approach eliminates the need for complex manual monitoring systems while maintaining high registration accuracy. The technology performs the monitoring function autonomously, reducing both system complexity and operational burden.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If automated commodity detection is implemented using image processing, then registration accuracy improves, but processing time and computational resources increase

Engineering Contradiction:
Improvecommodity detection accuracyVSAvoiddetection processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system continuously captures images of the shopping basket and pre-processes them to detect commodities before the customer completes the registration operation. By performing detection in advance and maintaining a buffer of detected commodity information, the system minimizes processing delays during the actual registration. This preliminary action approach ensures high detection accuracy while reducing the time penalty during critical registration moments.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250384747A1Information processing apparatus and information processing method
Publication Date: 2025.12.18 TOSHIBA TEC KK
  • US20250384747A1 patent drawing
  • US20250384747A1 patent drawing
  • US20250384747A1 patent drawing

AI summary

An information processing apparatus according to an embodiment for point-of-sale systems includes a communication interface for connecting to a communication network and a processor. The processor is configured to acquire an image of an inside of a shopping basket via the communication interface, detect a commodity in the shopping basket in the acquired image, receive a commodity identification for a registered commodity in a sales transaction, and, if the commodity identification for the registered commodity is received within a preset time period around the detection of the commodity in the shopping basket, generate a screen image by superimposing commodity information associated with the commodity identification for the registered commodity on the image of the inside of the shopping basket for enabling a user to identify the commodity in the shopping basket in conjunction with the superimposed commodity information.