Spatial Sound Visualization Using Microphone Array Direction Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mobile devices are unable to accurately capture the spatial sound field around them, which limits the ability to determine the directions of main sound sources with required precision.
Innovation Solution
The use of multiple omnidirectional microphones and advanced processing techniques, such as directional analysis on frequency-domain signals, to determine the directions of prominent sound sources and output visual effects indicating these directions on a display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple omnidirectional microphones are used to capture spatial sound field, then measurement precision of sound source directions is improved, but device complexity increases
Solution Approach 1:
The patent divides the sound field capture task into multiple frequency bands through spectral analysis. By processing different frequency components separately and applying directional analysis to each band, the system achieves precise spatial sound field capture without requiring an overly complex microphone array configuration.
Solution Approach 2:
The patent introduces visual effect elements as intermediaries to represent sound source directions. Instead of directly displaying complex acoustic data, the system converts directional information into visual representations (such as particles or graphical elements) that indicate sound source locations, simplifying the user interface while maintaining measurement precision.
2Measurement precision
If advanced processing techniques are applied to determine sound source directions, then measurement precision is improved, but loss of time in processing increases
Solution Approach 1:
The patent performs spectral analysis and identifies prominent sound sources in advance before conducting directional analysis. By pre-processing the audio signals to extract key features and filter out insignificant components, the system reduces the computational burden of subsequent directional calculations, thereby decreasing processing time while maintaining precision.
Solution Approach 2:
The patent focuses processing resources on analyzing only the prominent sound sources identified through spectral analysis, rather than processing all frequency components equally. This selective approach concentrates computational effort where it is most needed, achieving high measurement precision for significant sound sources while minimizing overall processing time.
3Loss of information
If visual effects are generated to represent sound source directions, then information presentation is improved, but use of energy by the device increases
Solution Approach 1:
The patent generates visual effects selectively based on the characteristics of prominent sound sources. By analyzing the spectral properties and directional information of significant sound sources, the system creates visual representations only where necessary to convey important spatial audio information, rather than uniformly activating the entire display, thus reducing energy consumption while maintaining effective information presentation.
Data Source
AI summary
Techniques are presented that include determining, using signals captured from two or more microphones configured to detect an acoustic signal from one or more sound sources, one or more prominent sound sources based on the one or more sound sources. The techniques also include determining one or more directions relative to a position of one or more of the two or more microphones for prominent sound source(s). The techniques further include outputting information suitable to be viewed on a display, the information providing for the prominent sound source(s) a visual effect indicating at least in part the one or more directions, relative to a position of one or more of the microphones, of the prominent sound source(s) in the acoustic signal. The information and the corresponding visual effect(s) may be presented on a display, e.g., as part of a screensaver.