Spatial Audio Reconstruction for Noise-Suppressed Sound Scenes
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing spatial audio processing techniques struggle with undesired noise and dominant sound sources, which compromise the accurate representation of audio scenes captured by microphone arrays, leading to suboptimal listener experience.
Innovation Solution
A spatial audio processing system that combines signals from multiple microphones to suppress undesired sound sources and enhance ambient sound components, using techniques like beamforming and ambience synthesis to create a reconstructed spatial audio signal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional spatial audio processing is used to capture audio scenes, then the complete audio scene is captured, but undesired noise and dominant sound sources compromise the accurate representation
Solution Approach 1:
The patent segments the audio scene into multiple spatial zones using a grid-based division of the three-dimensional space. Each zone is processed independently to identify and handle different sound sources (desired vs. undesired) in specific spatial regions, allowing precise control over noise suppression while preserving wanted audio content.
Solution Approach 2:
The patent applies different processing characteristics to different spatial zones. By analyzing the spatial distribution of sound sources and applying zone-specific gain adjustments and suppression techniques, the system preserves desired sound sources in certain zones while suppressing undesired noise in other zones, achieving local optimization of audio quality.
2Measurement precision
If beamforming and ambience synthesis are used to suppress noise, then the spatial audio image is enhanced, but the processing complexity increases
Solution Approach 1:
The patent divides the complex spatial audio processing task into manageable segments by creating a grid of zones in three-dimensional space. Each zone can be independently processed for noise suppression and ambience synthesis, breaking down the overall complex problem into simpler, localized processing tasks that are computationally more efficient.
Solution Approach 2:
The patent synthesizes ambient sound by creating virtual representations of the acoustic environment based on measurements from the microphone array. Instead of directly processing all raw audio signals, the system creates simplified models (copies) of the spatial audio scene that can be manipulated more efficiently while preserving the essential spatial characteristics.
Data Source
Figure 1~2
Figure 3
Figure 4~5
AI summary
According to an example embodiment, a technique for spatial audio processing on basis of two or more input audio signals that represent an audio scene and at least one further input audio signal that represents at least part of the audio scene is provided, the technique comprising identifying a portion of interest (POI) in the audio scene; processing the two or more input audio signals into a spatial audio signal where the POI in the audio scene is suppressed; generating, on basis of the at least one further input audio signal, a complementary audio signal that represents the POI in the audio scene; and combining the complementary audio signal with the spatial audio signal to create a reconstructed spatial audio signal.