Gesture Recognition Cloud Command Platform for Retail
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Consumers visiting brick and mortar stores face limitations in communicating with staff or interacting with store systems, as they must locate and approach live agents or kiosks, and existing mobile device interfaces are not integrated with the in-store experience, leading to a demand for streamlined communication and command execution.
Innovation Solution
A processor-implemented system that detects user gestures and biometric information to transmit commands to a remote system, allowing users to perform actions such as checking inventory or making purchases through a combination of vocal commands and physical gestures, integrating with a user's mobile device and enhancing the in-store shopping experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If consumers use traditional communication methods (live agents or kiosks) at brick and mortar stores, then communication can be established, but consumers must locate and approach the agent or kiosk, increasing time and reducing convenience
Solution Approach 1:
The patent replaces the mechanical system of physically locating and approaching live agents or kiosks with an optical/electromagnetic system using mobile device cameras and sensors to detect gestures and transmit commands wirelessly to store systems, eliminating the need for physical movement to communication points
Solution Approach 2:
The patent introduces a mobile device as an intermediary between the consumer and the store system. The mobile device captures gestures via camera, processes them through an application, and transmits commands wirelessly to the point-of-sale system, serving as a mediator that eliminates direct physical interaction requirements
2Adaptability or versatility
If mobile devices are used for virtual interaction with store online presence, then communication is enabled, but the interface is limiting and not integrated with the in-store shopping experience
Solution Approach 1:
The patent merges the virtual mobile device interface with the physical in-store environment by using the mobile device's camera to capture physical gestures in the store and translating them into digital commands that interact with the point-of-sale system, combining both virtual and physical interaction modes into a unified system
Solution Approach 2:
The patent transforms the static mobile device interface into a dynamic gesture recognition system. Instead of requiring users to navigate fixed menu options on a screen, the system dynamically interprets various physical hand gestures captured by the camera, allowing flexible and intuitive interaction that adapts to user movements in real-time
Data Source
AI summary
Systems and methods described herein are for transmitting a command to a remote system. A processing system determines the identity of the user based on the unique identifier and the biometric information. Thereafter, a sensor detects a gesture performed by the user. The sensor is configured to detect the gesture performed by the user when the user is located within the detectable range of the wireless antenna. The processing system determines an action associated with the detected gesture based on the identity of the user and sends a command to a remote computer system to cause it to perform the action associated with the detected gesture.