Customer Selection Determination System Using Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In physical merchant locations, customers often struggle to select products that are physically inaccessible, leading to error-prone and time-consuming interactions for both customers and merchants due to the need for merchants to guess the selected items.

Innovation Solution

A system utilizing beacon devices and customer devices to automatically determine the product or product identifier a customer is pointing at, using communication systems like BLE and cameras for gesture recognition, and referencing a database of product locations to provide accurate selection information to both parties.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If products are placed behind store windows or in display cases to protect them or improve display, then product security and display quality are improved, but customer accessibility and selection accuracy deteriorate

Engineering Contradiction:
Improveproduct securityVSAvoidcustomer accessibility
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces an intermediary system consisting of cameras, processors, and computing devices that mediate between the customer and the protected products. The system captures images of customer gestures, processes them to identify selected products, and communicates the selection to the merchant without requiring physical access to the products behind display cases or store windows.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If merchants manually guess customer selections from inaccessible products, then no additional hardware is needed, but time consumption and error rates increase

Engineering Contradiction:
Improvesystem simplicityVSAvoidselection determination time
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent replaces the mechanical/manual system of guessing customer selections with an automated optical recognition system. Cameras capture images of customer gestures, processors analyze the images to determine which products are selected, and the system communicates the results automatically, eliminating the time-consuming and error-prone manual guessing process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Device complexity

If merchants manually determine customer selections, then system complexity is low, but measurement precision and selection accuracy deteriorate

Engineering Contradiction:
Improvesystem complexityVSAvoidselection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary system consisting of cameras, processors, and computing devices that mediate between the customer and the protected products. The system captures images of customer gestures, processes them to identify selected products, and communicates the selection to the merchant without requiring physical access to the products behind display cases or store windows.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical/manual system of guessing customer selections with an automated optical recognition system. Cameras capture images of customer gestures, processors analyze the images to determine which products are selected, and the system communicates the results automatically, eliminating the time-consuming and error-prone manual guessing process.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10140637B2Customer selection determination system
Publication Date: 2018.11.27 PAYPAL INC
  • US10140637B2 patent drawing
  • US10140637B2 patent drawing
  • US10140637B2 patent drawing

AI summary

Systems and methods for determining a customer selection include receiving customer location information from at least one beacon device of a plurality of beacon devices that are located in a physical merchant location. The customer location information is collected by the at least one beacon device from a customer device that is associated with a customer. Customer selection indication data that is indicative of at least one physical gesture made by the customer is also received, and may be collected, for example, by cameras, object detection devices, communications between customer devices, etc. The customer location information and the customer selection indication data is then analyzed to determine a first product location in the physical merchant location that the customer is selecting, and a first product that is associated with the first product location in a database is determined. Information about the first product may then be sent to the customer device.