Spatial Audio Stream Merging Using Wave Representation Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing spatial audio processing technologies face challenges in merging multiple spatial audio streams effectively, particularly when direct merging of multi-channel DirAC streams is not possible, leading to difficulties in obtaining side information such as diffuseness and direction of arrival.
Innovation Solution
The proposed solution involves estimating wave representations for each spatial audio stream, including direction and magnitude measures, and processing these to obtain a merged wave representation with a merged diffuseness parameter, allowing for the creation of a merged audio stream that can be represented as a mono DirAC stream, even when individual streams lack diffuseness parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If direct merging of spatial audio streams is performed without multi-channel DirAC streams, then the merging process becomes problematic and loses accuracy, but using multi-channel DirAC streams increases device complexity and requires additional channels
Solution Approach 1:
The patent segments the spatial audio stream into distinct wave components (directional information) and diffuse components (spatial characteristics). By separating these elements, the system can process and merge them independently, achieving accurate spatial rendering without requiring complex multi-channel DirAC stream setups. The wave representation extraction isolates directional measures from the audio signal, allowing precise control over spatial parameters during merging.
Solution Approach 2:
The patent introduces wave representation as an intermediary structure that bridges the gap between mono audio streams and spatial rendering. This intermediate representation contains extracted directional and diffuseness information, enabling the system to achieve multi-channel-like spatial accuracy through processed mono streams. The wave representation acts as a mediator that carries essential spatial information without requiring actual multi-channel physical setups.
2Productivity
If wave representations are estimated and processed separately for each stream, then merging efficiency improves and spatial accuracy is maintained, but processing complexity increases
Solution Approach 1:
The patent performs preliminary extraction of wave representations, directional measures, and diffuseness parameters from each spatial audio stream before the merging process. By pre-processing and isolating these critical spatial parameters, the actual merging operation becomes more efficient and straightforward. The directional information and wave field measures are prepared in advance, allowing the merger to focus solely on combining the pre-extracted spatial characteristics without re-analyzing the full audio signals.
Data Source
AI summary
An apparatus for merging a first spatial audio stream with a second spatial audio stream to obtain a merged audio stream comprising an estimator for estimating a first wave representation comprising a first wave direction measure and a first wave field measure for the first spatial audio stream, the first spatial audio stream having a first audio representation and a first direction of arrival. The estimator being adapted for estimating a second wave representation comprising a second wave direction measure and a second wave field measure for the second spatial audio stream, the second spatial audio stream having a second audio representation and a second direction of arrival. The apparatus further comprising a processor for processing the first wave representation and the second wave representation to obtain a merged wave representation comprising a merged wave field measure and a merged direction of arrival measure, and for processing the first audio representation and the second audio representation to obtain a merged audio representation, and for providing the merged audio stream comprising the merged audio representation and the merged direction of arrival measure.