Audio Metadata Loudness Control for Adaptive Playback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current audio playback technologies face challenges in real-time dynamic loudness adjustment and dynamic range compression, especially when the entire audio program's loudness cannot be measured prior to encoding, leading to inferior loudness management that may alter the creative intent of the audio content.
Innovation Solution
A method and system for metadata-based dynamic processing of audio data, where a decoder receives a bitstream containing audio data and metadata, determines processing parameters based on playback conditions, and applies them to adjust loudness and dynamic range compression, allowing for real-time dynamic loudness adjustment and DRC, even in scenarios where the entire audio program's loudness cannot be measured.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the entire audio program is analyzed prior to encoding to determine loudness parameters, then loudness compliance and dynamic range control are improved, but the complexity of the encoding process increases and real-time encoding becomes difficult
Solution Approach 1:
The encoder performs preliminary loudness analysis and determines processing parameters before encoding the audio data. The encoder analyzes the entire audio program or segments, calculates loudness metrics (such as integrated loudness, momentary loudness, and dynamic range), and stores these parameters in metadata that will be embedded in the encoded audio stream. This preliminary action ensures loudness compliance is achieved without adding complexity to the real-time decoding process.
Solution Approach 2:
The audio program is divided into segments for analysis, allowing the encoder to determine loudness parameters for manageable portions of the content. Each segment can be analyzed independently, and the resulting parameters are stored as metadata associated with that segment. This segmentation approach makes the encoding process more tractable while still ensuring overall loudness compliance across the entire program.
2Reliability
If loudness processing is applied during encoding to ensure compliance, then loudness management is improved, but the creative intent of the original audio content may be altered
Solution Approach 1:
The system introduces metadata as an intermediary between the original audio content and the playback device. Instead of permanently modifying the encoded audio to achieve loudness compliance, the encoder embeds loudness parameters and processing information in metadata that travels with the audio stream. The playback device then uses this metadata to apply appropriate loudness adjustment, preserving the original creative intent while ensuring compliance. The metadata acts as a bridge that carries instructions for loudness management without altering the core audio content.
Solution Approach 2:
The encoder analyzes the audio program and determines optimal loudness processing parameters (such as gain adjustments, compression ratios, and threshold levels) that will achieve compliance while minimizing impact on creative intent. These parameters are stored in metadata and can be selectively applied by playback devices based on their capabilities and the specific content requirements. This parameter-based approach allows for flexible loudness management that respects the original artistic vision.
3Stability of the object's composition
If audio data is optimized for a single playback environment through loudness processing, then playback consistency is improved, but adaptability to different devices and environments is reduced
Solution Approach 1:
The system enables dynamic loudness adjustment at the playback device based on the embedded metadata. Instead of statically optimizing audio for one environment, the metadata contains processing parameters that allow playback devices to dynamically adapt the audio to their specific characteristics and the user's environment. The playback device can select and apply appropriate processing parameters from the metadata based on device type, acoustic environment, and user preferences, achieving both consistency and adaptability.
Solution Approach 2:
The metadata structure is designed to be universal and applicable across different playback devices and environments. It contains multiple sets of processing parameters that can accommodate various device capabilities (from mobile phones to home theater systems) and environmental conditions. This universal metadata approach allows a single encoded audio stream to be effectively played back across diverse platforms, with each device applying the most appropriate processing parameters from the metadata.
Data Source
AI summary
Described herein is a method of metadata-based dynamic processing of audio data for playback, the method including: receiving, by a decoder, a bitstream including audio data and metadata for dynamic loudness adjustment; decoding, by the decoder, the audio data and the metadata to obtain decoded audio data and the metadata; determining, by the decoder, from the metadata, one or more processing parameters for dynamic loudness adjustment based on a playback condition; applying the determined one or more processing parameters to the decoded audio data to obtain processed audio data; and outputting the processed audio data for playback. Described is further a method of encoding audio data and metadata for dynamic loudness adjustment into a bitstream. Moreover, described are a respective decoder and encoder, a respective system and computer program products.