TV Gesture Detection for Interactive Retail Demos

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In retail environments where customers cannot interact with TVs, manufacturers face difficulties in showcasing product features, and consumers struggle to make informed decisions due to TVs being tuned to in-store channels with advertisements, rather than demo content that highlights specific features.

Innovation Solution

Equipping TVs with a camera that detects gestures, such as smiles, to trigger on-demand demos, allowing interactive and engaging product demonstrations without requiring customers to use remote controls, thereby preempting other video inputs and providing feedback on video quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If TVs are tuned to in-store channels with advertisements for revenue generation, then the retailer earns compensation, but the TV cannot showcase product features effectively

Engineering Contradiction:
Improverevenue opportunityVSAvoidproduct feature demonstration
Core Design Contradiction:
Loss of energyVSLoss of information

Solution Approach 1:

The system pre-loads multiple demo content segments into the TV's memory before the customer arrives. When a gesture is detected, the appropriate pre-loaded demo segment is immediately displayed without needing to tune to external channels, thus preserving both revenue opportunities and product demonstration capability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The TV dynamically switches between advertisement mode and demo mode based on customer interaction. The system remains in advertisement mode by default for revenue generation, but can transition to demo mode when a gesture is detected, and return to advertisement mode after the demo concludes

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If tethered remote controls are provided for feature checking, then customers can interact with TV features, but the TV may be left in non-sales beneficial modes requiring staff vigilance

Engineering Contradiction:
Improvecustomer interaction capabilityVSAvoidTV mode consistency
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The TV automatically detects customer presence through gesture recognition and autonomously switches to demo mode without requiring a remote control. After the demo concludes or timing expires, the system automatically returns to its previous state, eliminating the need for staff to manually reset the TV

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors for customer gestures and provides real-time feedback by switching modes accordingly. The TV detects when a customer is present through gesture recognition and automatically adjusts its display mode, creating a self-regulating system that maintains appropriate states without staff intervention

Inventive Principle:
Principle #23Feedback

3Ease of operation

If gesture detection is implemented to trigger on-demand demos, then interactive product demonstrations are enabled, but additional hardware (camera) is required

Engineering Contradiction:
Improveinteractive demonstration capabilityVSAvoidhardware requirements
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The TV's existing camera, originally designed for video calling or content capture functions, is repurposed to detect customer gestures for demo triggering. This multi-functional use of the existing camera eliminates the need for dedicated gesture detection hardware while enabling interactive demonstrations

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables interactive and engaging product demonstrations that minimize disruption to commercial programming, allowing manufacturers to effectively showcase TV features and assist consumers in making informed purchasing decisions without the need for additional hardware or premium product placement.

Implementation Method 1

A computer processor receives a video image from the camera and having face detection and smile detection programming

Methodology Applied
Scientific EffectImage processing:

Data Source

PatentUS10356465B2Video system demonstration
Publication Date: 2019.07.16 SONY GROUP CORP
  • US10356465B2 patent drawing
  • US10356465B2 patent drawing
  • US10356465B2 patent drawing

AI summary

A television demonstration method involves providing a television display and a camera; at a computer processor, receiving a video image from the camera, the computer processor capturing the video image from the camera to determine if the viewer makes a predetermined gesture; and retrieving and playing a specified video segment on the display associated with the gesture in response to determining that the viewer has made the predetermined gesture. This abstract is not to be considered limiting, since other embodiments may deviate from the features described in this abstract.