Shopping Basket Image Overlay for Accurate POS Commodity Registration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In retail transaction systems, customers may perform erroneous commodity registrations unnoticed due to improper operations, which can go undetected by both the customer and store clerks.
Innovation Solution
An information processing apparatus and method that uses a cart terminal equipped with a camera to image the shopping basket, detect commodities, and superimpose augmented reality tags with commodity information on the basket image if the detection is followed by a timely registration, ensuring accurate registration and preventing errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If customers perform commodity registration operations using information communication terminals, then transaction processing can be performed at any place in the store, but erroneous operations may go unnoticed by both customers and store clerks
Solution Approach 1:
The system captures images of commodities in the shopping basket using a camera, detects the commodities automatically, and displays the detected commodity information on the terminal screen. This visual feedback allows customers to confirm whether their registration operations are correct, and enables store clerks to monitor for erroneous operations. The feedback mechanism directly addresses the reliability issue by providing real-time verification of registration accuracy.
2Reliability
If store clerks monitor commodity registration operations, then erroneous operations can be detected, but the system complexity and monitoring burden increase
Solution Approach 1:
The system enables self-service monitoring by automatically capturing images of the shopping basket, detecting commodities using image processing, and displaying the detected information on the terminal. This automated self-service approach eliminates the need for complex manual monitoring systems while maintaining high registration accuracy. The technology performs the monitoring function autonomously, reducing both system complexity and operational burden.
3Measurement precision
If automated commodity detection is implemented using image processing, then registration accuracy improves, but processing time and computational resources increase
Solution Approach 1:
The system continuously captures images of the shopping basket and pre-processes them to detect commodities before the customer completes the registration operation. By performing detection in advance and maintaining a buffer of detected commodity information, the system minimizes processing delays during the actual registration. This preliminary action approach ensures high detection accuracy while reducing the time penalty during critical registration moments.
Data Source
AI summary
An information processing apparatus according to an embodiment for point-of-sale systems includes a communication interface for connecting to a communication network and a processor. The processor is configured to acquire an image of an inside of a shopping basket via the communication interface, detect a commodity in the shopping basket in the acquired image, receive a commodity identification for a registered commodity in a sales transaction, and, if the commodity identification for the registered commodity is received within a preset time period around the detection of the commodity in the shopping basket, generate a screen image by superimposing commodity information associated with the commodity identification for the registered commodity on the image of the inside of the shopping basket for enabling a user to identify the commodity in the shopping basket in conjunction with the superimposed commodity information.


