Gesture Audio Interface With Visual Feedback for Reliable Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Voice-enabled devices face issues with command recognition due to proximity of multiple devices and language limitations, and current gesture-based systems are unreliable and lack clear feedback.

Innovation Solution

A gesture-enabled audio device with a sensor and light-emitting components that provide visual feedback based on user proximity and gesture recognition, allowing users to confirm input recognition and device interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture-based command systems are implemented, then user interaction without manual input is enabled, but reliability of gesture recognition is poor and user feedback is insufficient

Engineering Contradiction:
Improvegesture-based interactionVSAvoidgesture recognition reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent implements visual feedback through light-emitting devices that illuminate in response to detected gestures, providing users with immediate confirmation that their gestures have been recognized. This feedback mechanism directly addresses the reliability issue by making gesture recognition transparent and confirmable to the user.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent adds a visual dimension to gesture-based interaction by incorporating light-emitting devices that provide optical feedback. This transforms the interaction from purely gesture-based to a multi-sensory experience combining gesture input with visual confirmation, thereby enhancing reliability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Area of stationary object

If multiple voice-enabled devices are located proximate to each other, then device coverage is improved, but command recognition becomes unreliable due to interference

Engineering Contradiction:
Improvedevice coverage areaVSAvoidcommand recognition accuracy
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The visual feedback mechanism allows users to immediately determine which device has recognized their command, providing clarity in multi-device environments. This feedback helps users understand system state and reduces confusion about which device is responding.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent uses light emission and color changes in the light-emitting devices to indicate device state and command recognition. This visual signaling helps differentiate between multiple devices and their respective states, improving reliability in environments with multiple proximate devices.

Inventive Principle:
Principle #32Color changes

3Ease of operation

If voice control is used, then hands-free operation is achieved, but language limitations restrict usability

Engineering Contradiction:
Improvehands-free operationVSAvoidlanguage compatibility
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent combines gesture recognition with visual feedback to create a universal interaction method that does not depend on language. Gestures provide a language-independent interface while visual feedback ensures clear communication of system response, making the device accessible to users regardless of language proficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user interaction reliability and clarity by visually confirming gesture recognition and command execution, improving the effectiveness of gesture-based inputs.

Implementation Method 1

a light-emitting device that is communicatively coupled to the processor and that emits light in response to detecting the gesture

Methodology Applied
Scientific EffectLight emission: Light Emitting Diode

Implementation Method 2

a sensor communicatively coupled to a processor and configured to generate a presence signal in response to detecting an object within an interaction region

Methodology Applied
Scientific EffectGesture detection:

Data Source

PatentEP3458872B1Gesture-enabled audio device with visible feedback
Publication Date: 2021.04.07 HARMAN INT IND INC
  • EP3458872B1 patent drawingFigure 1
  • EP3458872B1 patent drawingFigure 2
  • EP3458872B1 patent drawingFigure 3

AI summary

An audio device includes a sensor communicatively coupled to a processor and configured to generate a presence signal in response to detecting an object within an interaction region, a loudspeaker communicatively coupled to the processor, at least one light-emitting device that is communicatively coupled to the processor, and the processor. The processor is configured to vary light output of the at least one light-emitting device based on the presence signal.