Audio Format Transition Handling for Gapless Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Switching between object-based audio and channel-based audio formats in adaptive streaming applications often results in discontinuities, mixing of unrelated channels, and unwanted gaps due to lack of special handling during transitions.
Innovation Solution
The method involves receiving frames of audio in different formats, decoding them, and generating output frames by performing rendering based on the decoded frames. This includes modifying audio data and object audio metadata to ensure gapless and smooth transitions, correct rendering of audio positions, and efficient use of existing components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If switching between object-based audio and channel-based audio formats is implemented in adaptive streaming, then adaptability to network conditions is improved, but discontinuities and mixing of unrelated channels occur during transitions
Solution Approach 1:
The patent applies preliminary action by preparing transition metadata in advance and pre-calculating channel mapping relationships between object-based and channel-based formats. The system pre-loads transition parameters and maintains a history of channel mappings to enable smooth transitions without discontinuities or channel mixing when switching formats during adaptive streaming.
2Device complexity
If direct switching between audio formats is performed without special handling, then device complexity is reduced, but gaps and artifacts appear in audio output
Solution Approach 1:
The patent introduces an intermediary transition handling mechanism that mediates between object-based and channel-based audio formats. This intermediary layer processes channel mapping, metadata generation, and signal blending to eliminate gaps and artifacts during format switching, while maintaining relatively simple device architecture through efficient use of existing audio processing components.
3Ease of operation
If channel mapping is not correctly handled during format switching, then ease of operation is improved, but audio positioning becomes incorrect
Solution Approach 1:
The patent implements feedback mechanisms that continuously monitor channel mapping status and audio positioning during format transitions. The system uses feedback from channel history information and metadata to automatically adjust and correct channel mappings, ensuring accurate audio positioning while maintaining simple operation through automated transition management.
Data Source
AI summary
The disclosure relates to a method and device for processing object-based audio and channel-based audio. The method comprises receiving a first frame of audio of a first format; receiving a second frame of audio of a second format different from the first format, the second frame for playback subsequent to the first frame; decoding the first frame of audio into a decoded first frame; decoding the second frame of audio into a decoded second frame; and generating a plurality of output frames of a third format by performing rendering based on the decoded first frame and the decoded second frame. The first format may be an object-based audio format and the second format is a channel-based audio format or vice versa.