Virtual Shopping Cart Automation via Computer Vision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional shopping sessions in physical stores are inefficient due to long wait times for customers and idle time for cashiers, especially during non-peak hours, and lack of automation in tracking customer purchases.
Innovation Solution
A system that generates a virtual store emulating a physical store, using camera feeds to create a virtual shopping cart and track customer selections, allowing for automated checkout and verification through algorithms and sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If traditional cashiers are used to serve customers, then customers can receive service, but customers spend considerable time waiting in line during busy periods
Solution Approach 1:
The system enables customers to perform checkout automatically without human cashier intervention. Cameras track customers as they shop, automatically identify selected items, and charge them when they exit the store, allowing customers to serve themselves and eliminating waiting in line
Solution Approach 2:
The patent replaces the mechanical system of manual cashiers with an automated computer vision system. Cameras, processors, and algorithms work together to track customers, identify items, and process payments automatically, substituting human labor with technological automation
2Ease of operation
If cashiers are present in the store, then customer service is available, but cashiers spend much time idle outside of peak business hours
Solution Approach 1:
The automated system allows customers to shop and checkout without human assistance, eliminating the need for cashiers to be physically present in the store. The system operates continuously without idle time, as the automated infrastructure remains active regardless of customer traffic
Solution Approach 2:
The patent introduces an automated system as an intermediary between customers and the store's checkout process. This intermediary (the computer vision system) handles all customer interactions automatically, removing the need for human cashiers while maintaining continuous service availability
3Loss of information
If manual tracking of customer purchases is used, then purchase data can be recorded, but the process is inefficient and requires human intervention
Solution Approach 1:
The patent replaces manual tracking methods with an automated computer vision system. Cameras continuously capture customer movements and item selections, while processors automatically analyze video feeds and identify purchased items, eliminating human intervention and significantly improving tracking efficiency
Solution Approach 2:
The automated tracking system operates continuously without interruption, constantly monitoring customer behavior and recording purchases in real-time. This continuous automated process eliminates the gaps and delays inherent in manual tracking, ensuring no purchase data is lost
Data Source
Figure 1A~1B
Figure 2A
Figure 2B
AI summary
An apparatus includes a display, interface, and processor. The interface receives video from a camera located in a physical store and directed at a first physical rack. The camera captures video of the rack during a shopping session. The processor displays a first virtual rack that emulates the first physical rack and includes first and second virtual shelves. The virtual shelves include virtual items, which include graphical representations of physical items located on the physical rack. The processor displays the rack video, which depicts an event including the person interacting with the first physical rack. The processor also displays a virtual shopping cart. The processor receives information associated with the event, identifying the first virtual item. The rack video depicts that the person selected the first physical item while interacting with the first physical rack. The processor then stores the first virtual item in the virtual shopping cart.