Audio Input Selection via Acoustic Proximity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In network-connected devices with distributed microphones, users experience poor audio quality and communication issues due to changing signal-to-noise ratios as they move within a physical space, leading to noisy and quiet speech, which affects both human perception and automated natural language processing systems.

Innovation Solution

A system determines the closest device to a sound source by comparing audio input energy and time difference of arrival between pairs of devices, using proximity data to select the optimal device for input and output, ensuring seamless audio processing and user experience across the space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If audio input is acquired from multiple distributed devices, then audio coverage across physical space is improved, but signal-to-noise ratio deteriorates as users move away from individual devices

Engineering Contradiction:
Improveaudio coverage areaVSAvoidsignal-to-noise ratio
Core Design Contradiction:
Area of stationary objectVSReliability

Solution Approach 1:

The system dynamically selects which device's audio input to use based on real-time proximity measurements. Instead of using audio from all devices simultaneously or from a fixed device, the system continuously determines which device is closest to the user and switches audio input sources accordingly, making the audio acquisition system adaptive to user movement

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent replaces physical proximity (mechanical/spatial relationship) with acoustic energy measurement and time difference of arrival calculations. By measuring acoustic energy levels and timing differences in audio arrival at multiple devices, the system can determine user proximity without physical contact or direct line-of-sight requirements

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If a single device is used for audio input, then device complexity is reduced, but adaptability to user movement deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidadaptability to user movement
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

Each device in the network independently measures its own acoustic energy levels and time difference of arrival data, then autonomously determines whether it is the closest device to the user. This distributed self-assessment approach eliminates the need for a centralized control system, reducing overall system complexity while maintaining adaptability

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent makes each device capable of performing multiple functions: audio acquisition, acoustic energy measurement, time difference calculation, and proximity determination. Each device serves as both a sensor and a potential audio input source, eliminating the need for dedicated control hardware and simplifying the system architecture

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If audio input selection is changed dynamically, then audio quality is improved, but processing time increases

Engineering Contradiction:
Improveaudio qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system continuously measures and monitors acoustic energy levels and time difference of arrival data in the background, even when not actively switching audio sources. This preliminary data collection ensures that when a user moves and a switch is needed, the proximity determination can be made rapidly using pre-captured measurements rather than initiating measurements from scratch

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses threshold-based decision making where audio input switching is triggered only when acoustic energy measurements or time difference calculations exceed predetermined thresholds indicating significant user movement. This approach skips unnecessary processing when the user remains in the same vicinity, reducing processing time while maintaining audio quality

Inventive Principle:
Principle #21Skipping (Rushing through)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for low-latency determination of the closest device, maintaining consistent audio quality and improving user experience by dynamically adjusting input and output selection based on user movement, even in scenarios with multiple users or noise sources.

Implementation Method 1

a first device of the plurality of devices determines first audio input data using a microphone of the first device

Methodology Applied
Scientific EffectAcoustic to electrical transduction:

Implementation Method 2

comparing audio input energy and time difference of arrival between pairs of devices

Methodology Applied
Scientific EffectTime difference of arrival: Time of Flight

Data Source

PatentUS11882415B1System to select audio from multiple connected devices
Publication Date: 2024.01.23 AMAZON TECH INC
  • US11882415B1 patent drawing
  • US11882415B1 patent drawing
  • US11882415B1 patent drawing

AI summary

A group of devices acquire audio input of a sound, such as speech, using respective microphones. For pairs of devices in the group, intensity of energy of audio input at each of the devices in the pair is used to determine first proximity data. Relative differences in time-of-arrival of the sound at the devices in the pair is used to determine second proximity data. The first and second proximity data are used to determine an estimated closest device of the pair with respect to the sound. Comparison of the first proximity data to the second proximity also allows a confidence value to be associated with the estimated closest device. The estimated closest device with the greatest confidence value may be selected for use to acquire audio input, present output, and so forth. Additional techniques such as beamforming techniques may be applied to the audio input from the selected device.