Direction of Arrival Estimation Using Acoustic Intensity Vectors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Direction-of-arrival estimation in sound source localization is affected by signal-to-noise ratio (SNR) and room reverberation, and DNN-based methods lack transparency in their learning processes, making it difficult to determine their application range.

Innovation Solution

A direction-of-arrival estimation device that includes a reverberation output unit, a noise suppression mask output unit, and a sound source direction-of-arrival derivation unit, utilizing three DNNs to remove reverberation and apply noise suppression masks to improve accuracy, specifically addressing SNR issues and model transparency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If DNN-based methods are used for DOA estimation, then robustness against SNR is improved, but transparency of the learning process deteriorates

Engineering Contradiction:
Improverobustness against SNRVSAvoidtransparency of learning process
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent segments the DOA estimation process into multiple interpretable stages: acoustic intensity vector calculation from microphone signals, reverberation component estimation using DNN, noise suppression mask generation, and final DOA derivation. Each stage produces intermediate results that can be analyzed and understood, maintaining transparency while achieving robustness through the structured multi-stage approach.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediate representations (acoustic intensity vectors, reverberation components, noise suppression masks) that serve as mediators between the raw input signals and the final DOA estimation. These intermediates make the learning process transparent by providing interpretable stages, while the DNN-based reverberation estimation maintains robustness against SNR variations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If reverberation removal and noise suppression are applied, then DOA estimation accuracy is improved, but computational complexity increases

Engineering Contradiction:
ImproveDOA estimation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes the reverberation component from the acoustic intensity vector using DNN-based estimation. By separating the reverberation component from the direct sound, the system improves DOA estimation accuracy while managing computational complexity through targeted processing of specific signal components rather than entire signal streams.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies noise suppression masks selectively in the time-frequency domain rather than uniformly across all frequencies and time frames. This partial action approach improves accuracy for relevant frequency regions while reducing unnecessary computational operations in regions where noise suppression is less critical, thereby balancing accuracy improvement with computational complexity management.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11922965B2Direction of arrival estimation apparatus, model learning apparatus, direction of arrival estimation method, model learning method, and program
Publication Date: 2024.03.05 NIPPON TELEGRAPH & TELEPHONE CORP
  • US11922965B2 patent drawing
  • US11922965B2 patent drawing
  • US11922965B2 patent drawing

AI summary

A direction-of-arrival estimation device for achieving direction-of-arrival estimation which is robust against an SNR and in which an application range of a learning model is specific is provided. The device includes: a reverberation output unit configured to receive input of a real spectrogram extracted from a complex spectrogram of acoustic data and an acoustic intensity vector extracted from the complex spectrogram, and output an estimated reverberation component of the acoustic intensity vector; a noise suppression mask output unit configured to receive input of the real spectrogram and the acoustic intensity vector from which the reverberation component has been subtracted, and output a time frequency mask for noise suppression; and a sound source direction-of-arrival derivation unit configured to derive a sound source direction-of-arrival based on an acoustic intensity vector formed by applying the time frequency mask to the acoustic intensity vector from which the reverberation component has been subtracted.