Audio Dynamic Range Reconstruction for Seamless Bitrate Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing adaptive distribution formats for audiovisual media face challenges in maintaining backward compatibility with legacy decoders while ensuring seamless bitrate switching and consistent dynamic range during playback, particularly in cases of network jitter or load variations.
Innovation Solution
A dual-mode decoding system that includes a parametric coding mode and a discrete coding mode, utilizing pre-processing DRC parameters to cancel encoder-side dynamic range limiting and apply decoder-side DRC adjustments, ensuring consistent dialogue levels and seamless bitrate transitions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If adaptive bitrate switching is implemented to handle network variations, then bandwidth efficiency is improved, but dynamic range inconsistencies and perceptible artifacts occur during bitrate transitions
Solution Approach 1:
The encoder applies dynamic range limiting to the core signal before parametric encoding, and transmits DRC parameters in the bitstream. This preliminary action ensures that when bitrate switching occurs, the dynamic range is already controlled, preventing inconsistencies during transitions between high and low bitrate modes.
Solution Approach 2:
The system transmits DRC parameters from encoder to decoder, creating a feedback mechanism that communicates dynamic range control information across the network. This allows the decoder to maintain consistent dynamic range behavior regardless of bitrate changes, as the DRC parameters guide the reconstruction process.
2Reliability
If encoder-side dynamic range limiting is applied to ensure consistent dialogue levels, then dynamic range consistency is improved, but loss of audio signal information occurs
Solution Approach 1:
The system changes the parameter representation by transmitting DRC parameters that describe the dynamic range limiting applied, rather than directly transmitting the limited signal. This allows the decoder to reconstruct the dynamic range characteristics without permanently losing the original signal information, as the DRC parameters enable accurate reproduction of dialogue levels.
3Ease of operation
If legacy decoder compatibility is maintained, then ease of operation is improved, but advanced DRC features and seamless bitrate switching cannot be implemented
Solution Approach 1:
The bitstream format is designed to be universal, containing DRC parameters that can be interpreted by both legacy decoders (which ignore them) and advanced decoders (which utilize them for seamless bitrate switching). This multi-functionality allows the same distribution format to serve both legacy and modern playback equipment without sacrificing advanced capabilities.
Data Source
Figure 1a~1b
Figure 2a~2c
Figure 3~5
AI summary
On the basis of a bitstream (P), an n-channel audio signal (X) is reconstructed by deriving an m-channel core signal (Y) and multichannel coding parameters (α) from the bitstream, where 1 ≤ m < n. Also derived from the bitstream are pre-processing dynamic range control, DRC, parameters (DRC2) quantifying an encoder-side dynamic range limiting of the core signal. The n-channel audio signal is obtained by parametric synthesis in accordance with the multichannel coding parameters and while cancelling any encoder-side dynamic range limiting based on the pre-processing DRC parameters. In particular embodiments, the reconstruction further includes use of compensated post-processing DRC parameters quantifying a potential decoder-side dynamic range compression. Cancellation of an encoder-side range limitation and range compression are preferably performed by different decoder-side components. Cancellation and compression may be coordinated by a DRC pre-processor.