Spatially Selective Audio Augmentation Using Beamforming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Audio augmentation of reality is challenging due to the difficulty in effectively controlling an audio environment, as incoming sound elements cannot be removed with a simple overlay like video elements, and conventional hearing aids do not provide sufficient control over environmental sounds.

Innovation Solution

The use of a multi-microphone active noise cancellation (ANC) headset for selective control and augmentation of environmental sounds, employing spatially selective processing to separate and enhance specific audio sources while blocking unwanted noise.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional hearing aids are used to enhance environmental sounds, then the perceptibility of specific sounds is improved, but the control over environmental sounds is insufficient

Engineering Contradiction:
Improveperceptibility of specific soundsVSAvoidcontrol over environmental sounds
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent segments the audio environment into multiple spatial zones using microphone arrays and beamforming technology. Different zones can be independently controlled with different gain levels, allowing selective enhancement of desired sounds while suppressing unwanted noises from specific directions. This spatial segmentation enables precise control over environmental sounds that conventional hearing aids cannot achieve.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces spatial dimensionality to audio control by utilizing directional microphone arrays and implementing three-dimensional sound field manipulation. Instead of uniform omnidirectional processing, the system creates spatially-selective audio zones that provide nuanced control over environmental sounds from different directions, resolving the limitation of conventional hearing aids.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Object-affected harmful factors

If active noise cancellation is applied to block unwanted noise, then ambient noise reduction is improved, but the intelligibility of useful audio components may be compromised

Engineering Contradiction:
Improveambient noiseVSAvoidintelligibility of useful audio components
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The patent applies local quality by implementing spatially-varying noise cancellation where different regions of the sound field receive different processing. Useful audio components from specific directions are preserved with minimal attenuation while noise from other directions is actively cancelled. This localized approach ensures that noise reduction does not compromise the intelligibility of important sound sources.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system employs feedback mechanisms where microphones continuously monitor the acoustic environment and the processed output is fed back to adjust the noise cancellation in real-time. This allows the system to distinguish between useful and harmful sounds dynamically, maintaining intelligibility while achieving effective noise reduction through adaptive control.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If spatially selective processing is used to separate source components, then the enhancement of specific sounds is improved, but the device complexity increases

Engineering Contradiction:
Improveseparation of source componentsVSAvoidprocessing system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements multi-functionality by designing a processing system that simultaneously performs noise cancellation, source separation, spatial filtering, and audio enhancement using a unified beamforming framework. This universal approach consolidates multiple functions into a single integrated system, reducing overall complexity compared to implementing separate systems for each function while maintaining high separation precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for effective replacement of real audio signals with virtual audio, providing improved environmental listening capabilities and enhanced perceptibility of specific sounds while reducing ambient noise, thus enhancing the audio augmentation experience.

Implementation Method 1

the active noise cancellation filter is configured to perform a directionally selective processing operation (e.g., to attenuate sound from the direction of the user's mouth)

Methodology Applied
Scientific EffectActive noise cancellation:

Data Source

PatentEP2679022B1Systems, methods, apparatus, and computer-readable media for spatially selective audio augmentation
Publication Date: 2021.10.27 QUALCOMM INC
  • EP2679022B1 patent drawingFigure 1A~1B
  • EP2679022B1 patent drawingFigure 2A~2D
  • EP2679022B1 patent drawingFigure 3A~3D

AI summary

Spatially selective augmentation of a multichannel audio signal is described.