Direction of Arrival Estimation Using Acoustic Intensity Vectors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Direction-of-arrival estimation in sound source localization is affected by signal-to-noise ratio (SNR) and room reverberation, and DNN-based methods lack transparency in their learning processes, making it difficult to determine their application range.
Innovation Solution
A direction-of-arrival estimation device that includes a reverberation output unit, a noise suppression mask output unit, and a sound source direction-of-arrival derivation unit, utilizing three DNNs to remove reverberation and apply noise suppression masks to improve accuracy, specifically addressing SNR issues and model transparency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If DNN-based methods are used for DOA estimation, then robustness against SNR is improved, but transparency of the learning process deteriorates
Solution Approach 1:
The patent segments the DOA estimation process into multiple interpretable stages: acoustic intensity vector calculation from microphone signals, reverberation component estimation using DNN, noise suppression mask generation, and final DOA derivation. Each stage produces intermediate results that can be analyzed and understood, maintaining transparency while achieving robustness through the structured multi-stage approach.
Solution Approach 2:
The patent introduces intermediate representations (acoustic intensity vectors, reverberation components, noise suppression masks) that serve as mediators between the raw input signals and the final DOA estimation. These intermediates make the learning process transparent by providing interpretable stages, while the DNN-based reverberation estimation maintains robustness against SNR variations.
2Measurement precision
If reverberation removal and noise suppression are applied, then DOA estimation accuracy is improved, but computational complexity increases
Solution Approach 1:
The patent extracts and removes the reverberation component from the acoustic intensity vector using DNN-based estimation. By separating the reverberation component from the direct sound, the system improves DOA estimation accuracy while managing computational complexity through targeted processing of specific signal components rather than entire signal streams.
Solution Approach 2:
The patent applies noise suppression masks selectively in the time-frequency domain rather than uniformly across all frequencies and time frames. This partial action approach improves accuracy for relevant frequency regions while reducing unnecessary computational operations in regions where noise suppression is less critical, thereby balancing accuracy improvement with computational complexity management.
Data Source
AI summary
A direction-of-arrival estimation device for achieving direction-of-arrival estimation which is robust against an SNR and in which an application range of a learning model is specific is provided. The device includes: a reverberation output unit configured to receive input of a real spectrogram extracted from a complex spectrogram of acoustic data and an acoustic intensity vector extracted from the complex spectrogram, and output an estimated reverberation component of the acoustic intensity vector; a noise suppression mask output unit configured to receive input of the real spectrogram and the acoustic intensity vector from which the reverberation component has been subtracted, and output a time frequency mask for noise suppression; and a sound source direction-of-arrival derivation unit configured to derive a sound source direction-of-arrival based on an acoustic intensity vector formed by applying the time frequency mask to the acoustic intensity vector from which the reverberation component has been subtracted.


