Parameter-Domain Audio Mixing for Real-Time Multi-Stream Combination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio coding techniques lack the ability to efficiently combine multiple parametrically coded audio streams without requiring decoding and subsequent re-encoding, leading to high computational complexity and delay, making it unfeasible for real-time applications like teleconferencing.
Innovation Solution
An audio signal generator that combines parametrically coded audio signals by directly mixing down-mix channels and associated parameters within the parameter domain, using simple arithmetic operations such as summation and weight calculations, without reconstructing the individual audio signals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple parametrically coded audio streams are combined by decoding and re-encoding, then audio quality is preserved, but computational complexity and processing delay increase significantly
Solution Approach 1:
The patent extracts only the essential parameter information from the parametrically coded audio streams, separating it from the full audio signal. By working directly with these extracted parameters (spatial cues, power ratios, etc.) rather than reconstructing complete audio signals, the system achieves combination with minimal computational effort while preserving the critical audio quality attributes that depend on accurate parameter representation.
Solution Approach 2:
The patent transforms the combination operation from signal-domain processing to parameter-domain processing. Instead of decoding audio signals and re-encoding them (which requires complex computational operations), the system directly manipulates the parameter sets through arithmetic operations like weighted summation. This parameter-based approach maintains audio quality while dramatically reducing computational complexity and processing delay.
2Measurement precision
If multiple parametrically coded audio streams are combined by decoding and re-encoding, then audio quality is preserved, but processing delay increases
Solution Approach 1:
The patent extracts only the essential parameter information from the parametrically coded audio streams, separating it from the full audio signal. By working directly with these extracted parameters (spatial cues, power ratios, etc.) rather than reconstructing complete audio signals, the system achieves combination with minimal computational effort while preserving the critical audio quality attributes that depend on accurate parameter representation.
Solution Approach 2:
The patent performs preliminary extraction of parameter information during the encoding stage, storing spatial cues, power ratios, and other critical parameters in a compact form. When combination is needed, these pre-extracted parameters are directly available for manipulation without requiring time-consuming decoding operations, thus minimizing processing delay while maintaining audio quality.
3Productivity
If multiple parametrically coded audio streams are combined using simple arithmetic operations, then computational effort is reduced, but the ability to preserve audio quality may be compromised
Solution Approach 1:
The patent transforms the combination operation from signal-domain processing to parameter-domain processing. Instead of decoding audio signals and re-encoding them (which requires complex computational operations), the system directly manipulates the parameter sets through arithmetic operations like weighted summation. This parameter-based approach maintains audio quality while dramatically reducing computational complexity and processing delay.
Solution Approach 2:
The patent creates a simplified representation (copy) of the audio streams in the form of parameter sets that capture the essential characteristics needed for quality combination. These parameter copies contain spatial cues, power ratios, and other critical information that can be manipulated arithmetically to produce high-quality combined output without requiring the computationally intensive processing of full audio signals.
4Quantity of substance
If parametric audio coding is used to reduce transmission bandwidth, then data rate is reduced, but combining multiple streams becomes more complex
Solution Approach 1:
The patent extracts only the essential parameter information from the parametrically coded audio streams, separating it from the full audio signal. By working directly with these extracted parameters (spatial cues, power ratios, etc.) rather than reconstructing complete audio signals, the system achieves combination with minimal computational effort while preserving the critical audio quality attributes that depend on accurate parameter representation.
Solution Approach 2:
The patent transforms the combination operation from signal-domain processing to parameter-domain processing. Instead of decoding audio signals and re-encoding them (which requires complex computational operations), the system directly manipulates the parameter sets through arithmetic operations like weighted summation. This parameter-based approach maintains audio quality while dramatically reducing computational complexity and processing delay.
Data Source
AI summary
According to the present invention, multiple parametrically encoded audio signals can be efficiently combined using an audio signal generator, which generates an audio output signal by combining the down-mix channels and the associated parameters of the audio signals directly within the parameter domain, i.e. without reconstructing or decoding the individual input audio signals prior to the generation of the audio output signal. This is achieved by direct mixing of the associated down-mix channels of the individual input signals. It is one key feature of the present invention that the combination of the down-mix channels is achieved by simple, computationally inexpensive arithmetic operations.