Audio Command Reception Using Directional Beamforming

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Electronic devices face challenges in accurately receiving and responding to audio commands due to noise interference, which can lead to incorrect command execution or failure to perform intended actions.

Innovation Solution

The method involves determining the position of a display device and a user, enhancing audio from the user while de-enhancing audio from the display device or noise sources using a microphone array and beam forming techniques, and recognizing commands through trigger words to control media and display devices effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If audio commands are received in noisy environments, then the device can operate in various conditions, but the accuracy of command recognition deteriorates due to noise interference

Engineering Contradiction:

Improveoperational capability in various environmentsVSAvoidaudio command recognition accuracy

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The audio signal is segmented by direction of arrival, separating user speech from display device audio and noise sources. The system divides the audio spectrum into different spatial segments, processing each segment independently to enhance command recognition accuracy while maintaining operational capability in noisy environments.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different quality processing is applied to different spatial regions. Audio from the user's direction receives enhancement processing, while audio from display device directions receives suppression processing. This local quality differentiation allows the system to maintain high recognition accuracy for commands while filtering out environmental noise.

Inventive Principle:

Principle #3Local quality

2Device complexity

If audio from all directions is processed equally, then the system remains simple, but noise from display devices and environment interferes with command recognition

Engineering Contradiction:

Improveaudio processing system simplicityVSAvoidnoise interference from display devices

Core Design Contradiction:

Device complexityVSObject-affected harmful factors

Solution Approach 1:

The system adds a spatial dimension to audio processing by determining directions of arrival for different audio sources. Instead of processing audio equally from all directions, the system uses directional information to differentiate between user commands and noise sources, effectively adding a spatial filtering dimension that reduces noise interference.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system introduces an intermediary processing stage that analyzes the direction of arrival of audio signals. This intermediary layer separates desired audio (from user direction) from unwanted audio (from display device directions) before final processing, acting as a mediator that reduces noise interference while preserving command recognition.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Measurement precision

If the device enhances all audio inputs, then command detection sensitivity improves, but noise from display devices and environment is also amplified

Engineering Contradiction:

Improvecommand detection sensitivityVSAvoidamplified noise from display devices

Core Design Contradiction:

Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

Instead of enhancing all audio inputs uniformly, the system inverts the approach by suppressing audio from specific directions (display device directions) while enhancing audio from the user direction. This inverted strategy achieves high command detection sensitivity without amplifying harmful noise from display devices.

Inventive Principle:

Principle #13The other way round (Inversion)

Solution Approach 2:

The system converts the harmful noise from display devices into a useful directional reference. By identifying the direction of display device audio, the system uses this previously harmful information to create spatial filters that protect against noise while enhancing command detection from the user direction.

Inventive Principle:

Principle #22Blessing in disguise (Convert harm into benefit)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the accuracy of audio command recognition, reducing noise interference and enabling reliable operation of media and display devices based on user inputs, even in noisy environments.

Implementation Method 1

enhancing audio from the user while de-enhancing audio from the display device or noise sources using a microphone array and beam forming techniques

Methodology Applied

Scientific EffectBeam forming:

Data Source

PatentEP3535754B1Improved reception of audio commands

Publication Date: 2022.11.16 ROKU INC

Figure 1
Figure 2
Figure 3

AI summary

Disclosed herein are system, apparatus, article of manufacture, method and/or computer program product embodiments, and/or combinations and sub-combinations thereof, for controlling a media device and a display device using audio commands. In so doing, some embodiments operate to suppress noise from the display device, and enhance audio commands from users. Some embodiments operate by determining a position of the display device and de-enhancing audio from the display device based on the display device position. The position of the user is determined, and audio from the user based on the user position is enhanced. Then, a command in the enhanced user audio is identified, and the media device and/or the display device are caused to operate according to the command.