Concurrent Sound Source Localization Using Time-Multiplexed Beamforming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Miniaturization of mobile computing and communication devices makes it space and cost prohibitive to include microphone arrays for concurrent sound source localization, limiting the number of sound sources that can be localized simultaneously.
Innovation Solution
A method and system that uses upsampling and time-multiplexing of audio signals from two or more microphones to distribute them to multiple beamformers, allowing concurrent localization of multiple sound sources by constraining each beamformer's localization based on the previous one, enabling efficient sound source localization in devices with limited microphones.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If microphone arrays with many microphones are used to localize multiple sound sources, then the number of sound sources that can be localized simultaneously increases, but the device size and cost increase
Solution Approach 1:
The patent applies periodic action through time-multiplexed beamforming, where beamformers sequentially process audio signals from different time slots. Each beamformer is activated in alternating time intervals to localize different sound sources, enabling multiple sources to be tracked concurrently using only two microphones. This periodic switching allows the system to achieve multi-source localization capability without requiring a large microphone array.
2Measurement precision
If microphone arrays with many microphones are used to localize multiple sound sources, then the number of sound sources that can be localized simultaneously increases, but the manufacturing cost increases
Solution Approach 1:
The patent applies periodic action through time-multiplexed beamforming, where beamformers sequentially process audio signals from different time slots. Each beamformer is activated in alternating time intervals to localize different sound sources, enabling multiple sources to be tracked concurrently using only two microphones. This periodic switching allows the system to achieve multi-source localization capability without requiring a large microphone array.
3Device complexity
If a single microphone is used for noise cancellation, then device complexity is reduced, but the ability to concurrently localize multiple sound sources is limited
Solution Approach 1:
The patent applies periodic action through time-multiplexed beamforming, where beamformers sequentially process audio signals from different time slots. Each beamformer is activated in alternating time intervals to localize different sound sources, enabling multiple sources to be tracked concurrently using only two microphones. This periodic switching allows the system to achieve multi-source localization capability without requiring a large microphone array.
Solution Approach 2:
The patent applies dynamics through adaptive beamforming coefficients that are continuously updated based on sound source locations. The beamformers dynamically adjust their weightings and constraints to track moving sound sources in real-time, allowing the system to maintain accurate localization of multiple concurrent sources despite using a minimal microphone configuration.
Data Source
AI summary
In aspects of concurrent sound source localization of multiple speakers, audio signals from two or more microphones are upsampled, and then the upsampled audio signals are time-multiplexed to a plurality of beamformers. A first sound source received at the two or more microphones is localized at a first beamformer, and a second sound source received at the two or more microphones is localized at a second beamformer, where localizing the second sound source is constrained by the localization of the first sound source. The beamformers can filter the upsampled audio signals using beamformer coefficients from the localizations to produce beamformed audio signals.