In-Store Feedback System Using Gaze and Gesture Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In-store shopping lacks mechanisms for shoppers to determine fast-moving or best-selling products, as they cannot access feedback from other shoppers, leading to potential dissatisfaction and slower decision-making.

Innovation Solution

An in-store feedback system using gaze tracking and gesture recognition to collect and provide positive or negative feedback on items, allowing shoppers to identify preferred products and retrieve feedback from others through predefined gestures or spoken language.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If shoppers use traditional in-store shopping without feedback access, then the shopping process is simple, but shoppers cannot determine popular products and make decisions slower

Engineering Contradiction:
Improveaccess to customer feedbackVSAvoiddecision-making time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system implements a feedback mechanism where shoppers can view ratings and reviews from other customers about products in the store. This allows current shoppers to access collective purchasing decisions and product evaluations, enabling them to make informed choices about which products are popular or recommended without having to research externally.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary system (mobile device application) that mediates between the physical store environment and the shopper's information needs. The application acts as a bridge, providing access to feedback databases, product information, and social networking features without requiring the shopper to leave the store or use traditional research methods.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If shoppers cannot access feedback from other shoppers, then the shopping system is simple, but shopper satisfaction decreases

Engineering Contradiction:
Improvepurchase satisfactionVSAvoidcollective feedback information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The mobile application serves multiple functions within a single system: it provides access to customer feedback and reviews, enables social networking among shoppers, offers product recommendations, and allows users to share their own experiences. This multi-functional approach ensures that shoppers can access comprehensive information to make reliable purchasing decisions while maintaining system integration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system enables two-way feedback: shoppers can read feedback from others and also contribute their own reviews and ratings. This creates a continuous feedback loop that improves product information quality and helps future shoppers make more informed decisions, thereby increasing overall purchase satisfaction and reliability.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11107091B2Gesture based in-store product feedback system
Publication Date: 2021.08.31 TOSHIBA GLOBAL COMMERCE SOLUTIONS HLDG
  • US11107091B2 patent drawing
  • US11107091B2 patent drawing
  • US11107091B2 patent drawing

AI summary

As disclosed herein, an in-store feedback system permits shoppers to provide positive or negative feedback for a particular item using gestures or spoken language. To do so, the feedback system includes a gaze tracking module that identifies what product a shopper is currently focusing on. For example, a rack, which may contain multiple rows of shelves, is divided into a grid that includes a plurality of cells. By determining what cell the shopper is currently staring at, the gaze tracking system can identify a particular item by knowing which items are placed in which cell. The in-store feedback system may also include a gesture recognition system that identifies and decodes a gesture made by the shopper. For example, a thumbs up is positive feedback but a thumbs down is negative feedback. By recognizing the gesture, the gesture recognition system assigns positive or negative feedback to the item.