Adaptive Audio System Metadata Buffering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio systems face challenges in smoothly switching between object-based and channel-based audio, leading to potential muting or glitching due to processing overhead and latency issues, and struggle with efficiently handling rapid metadata updates in adaptive audio systems.
Innovation Solution
An adaptive audio system with in-band signaling metadata allows seamless switching between object-based and channel-based audio by using metadata encoded within the audio bitstream, enabling the DSP to select the correct processing chain without external communication, and an object audio renderer interface optimizes processor efficiency and metadata alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If out-of-band signaling is used to switch between object-based and channel-based audio, then the system can manage processing on the DSP, but processing overhead and transmission latencies cause muting or audio glitching
Solution Approach 1:
The system pre-loads and buffers metadata updates in advance before they are needed for audio processing. This preliminary action allows the DSP to have the necessary processing information ready before switching between object-based and channel-based audio, eliminating the latency and muting issues caused by real-time out-of-band signaling.
Solution Approach 2:
An intermediary metadata buffer is introduced between the audio source and the DSP processor. This buffer acts as a mediator that stores and manages metadata updates, allowing the DSP to process audio continuously without interruption while the metadata is prepared and transferred, thus preventing audio glitching during transitions.
2Ease of operation
If the DSP is reconfigured to handle new audio type through out-of-band signaling, then the correct processing chain can be selected, but processing overhead and data switching overhead cause audio glitching
Solution Approach 1:
The system prepares and validates the correct processing chain in advance by pre-loading metadata that indicates the upcoming audio type. This allows the DSP to switch between processing chains seamlessly without interruption, as the new processing configuration is already prepared and ready to be activated without causing audio glitching.
Solution Approach 2:
The audio processing maintains continuous operation by buffering metadata and using it to smoothly transition between processing chains. The useful action of audio processing continues uninterrupted while the system adapts to different audio types, preventing glitching by ensuring continuous audio flow during reconfiguration.
3Productivity
If rapid metadata updates are processed in real-time, then the system can adapt to changing audio content, but processing overhead increases and causes muting or audio delay
Solution Approach 1:
Metadata updates are buffered and prepared in advance before being processed by the DSP. This preliminary action allows the system to handle rapid metadata updates without real-time processing pressure, as the metadata is already organized and ready when needed, preventing audio delay while maintaining high update rates.
Solution Approach 2:
A metadata buffer acts as an intermediary between the audio source and the DSP processor. This buffer absorbs the variability in metadata update rates and provides a steady, predictable stream of metadata to the DSP, allowing rapid updates to be handled efficiently without causing audio delay or muting.
4Adaptability or versatility
If the system supports both object-based and channel-based audio with different post-processing mechanisms, then legacy audio content can be supported, but the processing chain must be reconfigured causing potential audio interruption
Solution Approach 1:
The system pre-loads metadata that indicates the audio type (object-based or channel-based) in advance, allowing the appropriate processing chain to be prepared before switching is needed. This ensures that when legacy channel-based audio or modern object-based audio is encountered, the correct processing mechanism is already in place, maintaining reliable continuous audio playback without interruption.
Solution Approach 2:
The DSP system is designed with universal processing capabilities that can handle both object-based and channel-based audio through a single unified architecture. By using metadata to dynamically select the appropriate processing path, the system achieves multi-functionality without requiring separate dedicated hardware paths, thus maintaining audio stream continuity while supporting multiple audio formats.
Data Source
Figure 1
Figure 2~3
Figure 4A~4B
AI summary
Embodiments are directed processing adaptive audio content by determining an audio type as one of channel-based audio and object-based audio for each audio segment of an adaptive audio bitstream, tagging the each audio segment with a metadata definition indicating the audio type of the corresponding audio segment, processing audio segments tagged as channel-based audio in a channel audio renderer component, and processing audio segments tagged as object-based audio in an object audio renderer component that is distinct from the channel audio renderer component. Object-based audio is rendered through an object audio renderer interface that dynamically adjusts processing block sizes of the object audio segments based on timing and alignment of metadata updates and maximum/minimum block size parameters.