Audio Signal Positioning via Depth Map Intermediary
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing three-dimensional audio technologies face challenges in accurately determining the position of sound sources, particularly in scenarios with multiple speakers or moving speakers, due to the limitations of microphone array size and spacing, leading to poor sound localization and communication issues.
Innovation Solution
A method and apparatus that utilize a microphone array to obtain audio signal direction and distance information by generating disparity or depth maps from auxiliary videos, allowing for accurate encoding and reproduction of audio signals without increasing the microphone array size, enabling precise sound source positioning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the number of microphones and the space between microphones are increased, then the measurement precision of sound direction and distance is improved, but the device complexity and size are increased
Solution Approach 1:
The patent introduces an auxiliary video as an intermediary to provide depth information about the sound source position. The auxiliary video captures depth data that is then integrated with audio signals from the microphone array, allowing the system to achieve accurate sound localization without requiring a large number of microphones or large spacing between them.
Solution Approach 2:
The patent merges audio signals from the microphone array with depth information from the auxiliary video. By combining these two types of information, the system achieves accurate determination of sound source position (both direction and distance) while maintaining a compact microphone array configuration.
2Device complexity
If the number of microphones and the space between microphones are decreased, then the device complexity is reduced, but the measurement precision of sound direction and distance is worsened
Solution Approach 1:
The auxiliary video serves as a mediator that compensates for the limited capabilities of a small microphone array. By introducing this additional information source, the system can achieve accurate sound localization despite using fewer microphones with smaller spacing.
Solution Approach 2:
The patent changes the information parameters available to the system by incorporating depth information from the auxiliary video. This additional parameter (depth) complements the audio signals, enabling accurate sound source positioning even with a reduced microphone array configuration.
3Device complexity
If a traditional microphone array is used without depth information, then the device complexity is reduced, but the reliability of sound source positioning is worsened
Solution Approach 1:
The auxiliary video acts as a mediator that provides the missing depth information component. This intermediary element bridges the gap between simple microphone array configurations and accurate three-dimensional sound source localization, enhancing reliability without significantly increasing system complexity.
Solution Approach 2:
The system achieves multi-functionality by using the auxiliary video to provide depth information that complements the directional information from the microphone array. This universal approach allows accurate sound source positioning in various scenarios without requiring complex specialized hardware for each function.
Data Source
Figure 1A~2
Figure 3
Figure 4A
AI summary
A method for generating and playing audio signals and a system for processing audio signals are disclosed. The method for generating audio signals includes: generating distance information about an audio signal corresponding to a view point position, according to obtained auxiliary video and direction information about the audio signal, where the auxiliary video is a disparity map or a depth map; encoding the direction information and distance information about the audio signal, and sending the encoded information. The apparatus for generating audio signals includes an audio signal distance information obtaining module and an audio signal encoding module. With the present invention, the position information, including direction information and distance information, about the audio signal may be obtained accurately in combination with a three-dimensional video signal and a three-dimensional audio signal, without increasing the size of a microphone array, and the audio signal is sent and played.