POS Shopping Basket Image Verification With AR Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In transaction processing systems, customers may perform erroneous commodity registrations unnoticed due to improper operations, which can go undetected by both the customer and store clerks.
Innovation Solution
An information processing apparatus and method that uses a cart terminal with a camera to image the shopping basket, detect commodities, and superimpose commodity information on the image using augmented reality (AR) to ensure timely registration and prevent errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If customers perform commodity registration operations using information communication terminals, then transaction processing can be performed at any place in the store, but erroneous operations may go unnoticed by both customers and store clerks
Solution Approach 1:
The system captures images of commodities in the shopping basket using a camera, detects the commodities automatically, and provides visual feedback by superimposing detected commodity information on the captured image. This feedback mechanism allows customers to verify whether their commodity registration operations are correct, thereby preventing erroneous operations from going unnoticed while maintaining the flexibility of self-service registration.
2Reliability
If store clerks monitor commodity registration, then errors can be detected, but the system complexity and operational burden increase
Solution Approach 1:
The system enables customers to perform commodity registration and verification themselves through the augmented reality display on their terminals. The camera captures the shopping basket, detects commodities automatically, and displays verification information without requiring store clerk intervention. This self-service approach maintains high reliability while avoiding the complexity and operational burden of clerk monitoring systems.
3Reliability
If visual confirmation of commodity registration is provided, then erroneous operations can be prevented, but additional system components and processing are required
Solution Approach 1:
The information communication terminal serves multiple functions: it acts as the user interface for commodity registration, the camera captures shopping basket images, the processing unit detects commodities and generates verification information, and the display shows the augmented reality feedback. By making the terminal multi-functional, the system provides visual confirmation without requiring separate dedicated components, thereby reducing overall system complexity while maintaining high reliability.
Data Source
AI summary
An information processing apparatus according to an embodiment for point-of-sale systems includes a communication interface for connecting to a communication network and a processor. The processor is configured to acquire an image of an inside of a shopping basket via the communication interface, detect a commodity in the shopping basket in the acquired image, receive a commodity identification for a registered commodity in a sales transaction, and, if the commodity identification for the registered commodity is received within a preset time period around the detection of the commodity in the shopping basket, generate a screen image by superimposing commodity information associated with the commodity identification for the registered commodity on the image of the inside of the shopping basket for enabling a user to identify the commodity in the shopping basket in conjunction with the superimposed commodity information.