Hands-free Device with Directional Audio Output

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional devices that utilize speech recognition technology require users to manually activate the speech recognition mode, limiting the experience to a partially hands-free interaction.

Innovation Solution

The system detects user actions such as voice commands or gaze direction to determine the user's location and responds with a steerable sound beam, allowing for hands-free operation by processing sound data from microphones or image data from cameras to output audible responses in the determined direction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional input mechanisms (buttons, keyboards) are used to activate speech recognition mode, then the device can be operated hands-free during speech input, but manual activation is still required which limits the hands-free experience

Engineering Contradiction:
Improvehands-free operationVSAvoidactivation mechanism
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system automatically detects user presence and intent through sensors (camera, microphone, proximity sensors) and activates speech recognition mode without requiring manual button presses. The device serves itself by monitoring the environment and autonomously transitioning to the appropriate interaction mode when it detects a user approaching or attempting to interact.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces mechanical button-press activation with sensor-based detection systems. Optical sensors (cameras), acoustic sensors (microphones), and proximity sensors substitute for physical buttons, enabling the system to detect user intent and activate speech recognition through non-contact means, thereby achieving true hands-free operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If speech recognition mode is activated continuously to enable hands-free operation, then hands-free interaction is available, but energy consumption increases

Engineering Contradiction:
Improvehands-free interaction availabilityVSAvoidenergy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

Instead of continuous activation, the system employs periodic sampling of sensor data (camera frames, audio levels, proximity readings) at intervals. The speech recognition mode is activated only when periodic detection confirms user presence and interaction intent, allowing the device to remain in low-power state during intervals when no user interaction is detected.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system performs preliminary detection using low-power sensors (proximity sensors, ambient light sensors, idle microphone monitoring) before fully activating the high-power speech recognition system. This preliminary action allows the device to prepare for potential speech recognition activation only when conditions warrant it, conserving energy during normal operation.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If audio responses are output in all directions, then all users can hear the response, but privacy is compromised for individual user interactions

Engineering Contradiction:
Improveaudio output coverageVSAvoiduser privacy
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system directs audio responses locally toward the specific user detected by sensors, rather than outputting sound uniformly in all directions. By determining the user's position through camera or sensor data and steering the audio output accordingly, the response is concentrated in the local region where the user is located, preventing other nearby users from overhearing private conversations.

Inventive Principle:
Principle #3Local quality

4Measurement precision

If the system uses multiple sensors (camera, microphone, proximity sensors) to detect user actions, then detection accuracy improves, but device complexity increases

Engineering Contradiction:
Improveuser action detection accuracyVSAvoidsensor system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensor types (camera, microphone, proximity sensors) into an integrated user detection system that operates cooperatively. By merging the detection capabilities of different sensors, the system achieves more accurate and reliable user action detection than any single sensor could provide alone, while managing complexity through integrated processing.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensor system is designed to perform multiple functions: proximity detection, user identification, gaze direction detection, and speech triggering. By making the sensor subsystem universal and multi-functional, the patent reduces overall system complexity compared to having separate dedicated systems for each function, as the same sensors serve multiple purposes in the user interaction pipeline.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a truly hands-free experience by directing audio responses only to the user, maintaining privacy and convenience without the need for manual activation of speech recognition mode.

Implementation Method 1

processing sound data from microphones

Methodology Applied
Scientific EffectSound detection: Sound

Implementation Method 2

processing image data from cameras

Methodology Applied
Scientific EffectImage processing: Image Processing

Implementation Method 3

output audible responses in the determined direction

Methodology Applied
Scientific EffectSound beam steering: Sound

Data Source

PatentUS10318016B2Hands free device with directional interface
Publication Date: 2019.06.11 HARMAN INT IND INC
  • US10318016B2 patent drawing
  • US10318016B2 patent drawing
  • US10318016B2 patent drawing

AI summary

Embodiments provide a non-transitory computer-readable medium containing computer program code that, when executed, performs an operation. The operation includes detecting a user action requesting an interaction with a first device and originating from a source. Additionally, embodiments determine a direction in which the source is located, relative to a current position of the first device. A response to the user action is also determined, based on a current state of the first device. Embodiments further include outputting the determined response substantially in the determined direction in which the source is located.