Downmix Loudness Metadata for Consistent Multi-Format Audio Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Consumer devices struggle to consistently reproduce high-quality, wide bandwidth audio content across varying media formats and playback environments due to limitations in dynamic range control and loudness consistency.
Innovation Solution
An audio processing system that includes an encoder and decoder capable of dynamic range control, where the encoder transmits dynamic range compression curves and auditory scene analysis parameters, allowing the decoder to customize audio processing based on specific playback environments and maintain consistent loudness levels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If dynamic range control is applied to audio content, then loudness consistency across different playback environments is improved, but device complexity increases due to the need for encoder and decoder with processing capabilities
Solution Approach 1:
The encoder performs preliminary dynamic range control processing on the audio content during encoding, calculating and embedding control parameters (such as reference loudness levels and compression curves) directly into the encoded audio stream. This preliminary action allows the decoder to simply apply pre-determined gain adjustments without requiring complex real-time analysis capabilities, thus improving loudness consistency while minimizing decoder complexity.
Solution Approach 2:
The patent introduces an intermediary processing layer that analyzes audio content and generates downmix loudness offset parameters. These parameters act as a bridge between the original multi-channel audio and the downmixed stereo output, enabling loudness compensation without requiring the end device to perform complex multi-channel processing. The intermediary parameters carry the necessary control information through the encoding stream.
2Adaptability or versatility
If downmix operations are performed on multi-channel audio content, then adaptability to different playback configurations is improved, but audio quality deteriorates due to loss of spatial information and potential clipping
Solution Approach 1:
The system performs preliminary loudness analysis and calculates appropriate gain adjustments before the actual downmix operation. By pre-calculating downmix loudness offset parameters based on the original multi-channel content's loudness characteristics, the system ensures that spatial information is preserved as much as possible while preventing clipping in the downmixed output.
Solution Approach 2:
The patent dynamically adjusts downmix parameters (such as channel gains and loudness offsets) based on the specific audio content and target playback configuration. By changing these parameters adaptively rather than using fixed downmix coefficients, the system maintains audio quality and prevents clipping while ensuring compatibility with different playback configurations including stereo and mono outputs.
3Reliability
If gain adjustments are applied to prevent clipping in downmixed audio, then reliability of playback is improved, but loudness consistency deteriorates due to excessive attenuation
Solution Approach 1:
The system applies different gain adjustments to different channels and frequency bands rather than using a single global gain factor. By analyzing the loudness characteristics of individual channels and applying localized gain compensation, the system prevents clipping in specific channels while maintaining overall loudness consistency. This localized approach allows selective attenuation only where necessary.
Solution Approach 2:
The encoder performs feedback analysis by monitoring the loudness levels of the downmixed audio output and adjusting the downmix loudness offset parameters accordingly. This feedback mechanism ensures that gain adjustments are optimized to prevent clipping while minimizing unnecessary attenuation, thereby maintaining loudness consistency across different playback environments.
Data Source
AI summary
Audio content coded for a reference speaker configuration is downmixed to downmix audio content coded for a specific speaker configuration. One or more gain adjustments are performed on individual portions of the downmix audio content coded for the specific speaker configuration. Loudness measurements are then performed on the individual portions of the downmix audio content. An audio signal that comprises the audio content coded for the reference speaker configuration and downmix loudness metadata is generated. The downmix loudness metadata is created based at least in part on the loudness measurements on the individual portions of the downmix audio content.