Sound Source Visualization via Microphone Array Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current autonomous vehicle technologies primarily rely on visual signal processing for obstacle recognition, lacking effective sound signal processing and visualization, which is essential for fully autonomous driving similar to human driving.
Innovation Solution
A sound source visualization device and method that utilize multiple sound source detection sensors to detect and preprocess sound signals, calculate sound source location, altitude, intensity, and movement, and convert this information into a visual format for intuitive recognition, using a combination of sound source detection, preprocessing, calculation, search, and visualization modules.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If visual signal processing is used for obstacle recognition, then obstacle detection capability is improved, but sound source information recognition capability deteriorates
Solution Approach 1:
The autonomous vehicle is equipped with both visual sensors (cameras) and acoustic sensors (microphones arranged in arrays) to enable the system to perform both visual obstacle detection and acoustic sound source recognition simultaneously. This multi-functional sensor system allows the vehicle to process both visual and auditory information for comprehensive environmental awareness.
Solution Approach 2:
The acoustic signal processing is segmented into distinct functional modules: sound source detection using microphone arrays, spatial localization through time difference of arrival calculations, altitude determination via vertical microphone spacing, and intensity measurement. This segmentation allows each aspect of sound source information to be processed independently and integrated with visual data.
2Loss of information
If sound source detection sensors are added to the autonomous vehicle, then sound source information recognition capability is improved, but device complexity deteriorates
Solution Approach 1:
The microphone array system is designed to perform multiple functions simultaneously: detecting sound source direction, determining altitude, measuring intensity, and identifying sound types. This multi-functional acoustic sensor system reduces the need for separate specialized sensors for each measurement, thereby limiting the increase in overall device complexity.
Solution Approach 2:
The acoustic signal processing functions (detection, localization, altitude determination, intensity measurement) are merged into a unified sound source recognition system that works in conjunction with the visual obstacle detection system. This integration allows both visual and acoustic information to be processed together for comprehensive environmental perception.
3Measurement precision
If three-dimensional sound source location information including altitude is calculated, then sound source localization accuracy is improved, but calculation complexity deteriorates
Solution Approach 1:
The three-dimensional localization calculation is segmented into horizontal plane localization (using time difference of arrival between horizontally spaced microphones) and vertical altitude determination (using time difference of arrival between vertically spaced microphones). This segmentation allows each dimensional component to be calculated independently using simplified geometric relationships, reducing overall computational complexity while maintaining accuracy.
Solution Approach 2:
The system transitions from two-dimensional horizontal localization to three-dimensional localization by incorporating the altitude dimension. Additional microphones are positioned at different vertical heights, and the time difference of arrival signals are analyzed to calculate the vertical position component, thereby adding the third dimension to the localization accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and intuitive determination of sound source information, including altitude and intensity, enhancing emergency situation awareness and preventing accidents by converting sound signals into visual information for both autonomous vehicles and individuals with weak hearing.
Implementation Method 1
a sound source detection module configured to detect sound source signals, including a surrounding sound, sound sources, and noise, by using a plurality of sound source detection sensors
Implementation Method 2
a preprocessing module configured to filter out the noise from the detected sound source signal
Implementation Method 3
a calculation module configured to calculate an approximate sound source location, including a separation distance from the sound source visualization device, direction, sound source intensity, two-dimensional position, and altitude information of the sound source, by analyzing the preprocessed sound source signal
Data Source
AI summary
There are provided a sound source visualization device and method. A sound source visualization device according to an embodiment includes: a sound source detection module configured to detect a sound source signal by using a plurality of sound source detection sensors; a preprocessing module configured to filter out the noise and amplify the sound source signal; a calculation module configured to calculate an approximate sound source location by analyzing the preprocessed sound source signal; a search module configured to generate a plurality of pseudo-planes by using the altitude information, to select planes, and to generate three-dimensional sound source location and altitude information by including information, obtained using the selected planes, in the approximate sound source location; and a visualization module configured to output sound source information to a preset system host or to convert this sound source information into a visualization signal and display the visualized signal.