Retail Gesture Recognition Using Machine-Readable Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current retail processes in environments like grocery stores lack efficient methods for user interaction with products, particularly in facilitating purchases and inventory management using machine-readable images and user gestures.

Innovation Solution

A system and method that capture machine-readable images and user gestures, where a computing device identifies the image and determines if the gesture interacts with it according to a predetermined action, thereby implementing specific retail processes such as adding products to a cart or inventory lists, using image recognition and augmented reality to enhance user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional manual retail processes are used for product identification and inventory management, then operational simplicity is maintained, but productivity and efficiency are reduced

Engineering Contradiction:
Improveretail operation efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system enables self-service retail operations where customers can independently scan product barcodes using their mobile devices, automatically add items to virtual carts, and complete purchases without manual intervention from retail personnel. This automated self-service approach significantly improves productivity while maintaining manageable system complexity through widely available mobile technology.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical processes (physical scanning by personnel, paper-based inventory tracking) with automated optical and digital systems. Mobile devices capture barcode images, automatically process product identification, and digitally track inventory, substituting mechanical human operations with automated computational processes that enhance efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of time

If manual product scanning and inventory tracking are performed, then ease of operation is maintained, but loss of time occurs during transactions

Engineering Contradiction:
Improvetransaction timeVSAvoiduser interaction difficulty
Core Design Contradiction:
Loss of timeVSEase of operation

Solution Approach 1:

The system performs preliminary actions by automatically capturing barcode information as soon as the product is scanned, immediately identifying the product, and pre-populating the virtual cart before the customer even finishes selecting items. This preliminary automated processing eliminates sequential delays and significantly reduces overall transaction time while maintaining ease of operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements continuous useful action through real-time barcode scanning and immediate product identification throughout the shopping process. Instead of batch processing at checkout, the system continuously captures, processes, and updates product information as customers shop, eliminating idle time and maintaining continuous productive action from selection through purchase.

Inventive Principle:
Principle #20Continuity of useful action

3Productivity

If computing devices are used to capture barcodes for purchase facilitation, then productivity is improved, but device complexity increases

Engineering Contradiction:
Improvepurchase transaction efficiencyVSAvoidcomputing device requirements
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system leverages the universal multi-functionality of mobile devices that already exist in customers' pockets. The same device used for communication, photography, and navigation is also used for barcode scanning and purchase transactions. This universal application of existing multi-functional devices improves purchase transaction efficiency without adding specialized equipment or increasing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent uses the camera function of mobile devices to capture optical copies of barcode images, converting physical barcode information into digital data that can be processed instantly. This copying approach allows any device with camera capability to function as a scanning device, improving transaction efficiency without requiring specialized scanning hardware or increasing device complexity.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10216284B2Systems and methods for implementing retail processes based on machine-readable images and user gestures
Publication Date: 2019.02.26 TOSHIBA GLOBAL COMMERCE SOLUTIONS HLDG
  • US10216284B2 patent drawing
  • US10216284B2 patent drawing
  • US10216284B2 patent drawing

AI summary

Systems and methods for implementing retail processes based on machine-readable images and user gestures are disclosed. According to an aspect, a method includes capturing one or more images including a machine-readable image and a user gesture. The method also includes identifying the machine-readable image as being associated with a product. Further, the method includes determining whether the user gesture interacts with the machine-readable image in accordance with a predetermined gesture. The method also includes implementing a predetermined retail process in association with the product in response to determining that the user gesture interacts with the machine-readable image in accordance with the predetermined gesture.