MPEG-H 3D Audio Auxiliary Stream Embedding for Legacy Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in efficiently merging and reproducing main and auxiliary media streams over standardized interfaces due to the limitations of standardized interfaces only supporting a single data stream, requiring high computational power and non-optimal matching with the reproduction system.
Innovation Solution
The method involves encapsulating auxiliary media streams within packets of the main media stream using dedicated tags in the packet headers, allowing legacy devices to ignore additional packets and enabling modified decoders to process and merge these streams, while incorporating time-alignment and gain control units for synchronized reproduction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If auxiliary media streams are embedded in MPEG-H 3D audio streams, then the reproduction system can achieve optimal matching and efficient processing, but standardized interfaces that only support a single data stream cannot directly transmit multiple streams
Solution Approach 1:
The patent merges multiple media streams (main audio and auxiliary media streams) into a single multiplexed bitstream that can be transmitted through standardized interfaces. The auxiliary stream is embedded within the MPEG-H 3D audio stream structure, allowing both streams to share the same transmission channel and be processed efficiently by the reproduction system.
Solution Approach 2:
The standardized interface is made multi-functional by enabling it to carry both main audio data and auxiliary media data within a single stream. The interface maintains its original single-stream capability while gaining the ability to transport multiple types of content through the same channel using a unified packet structure.
2Adaptability or versatility
If multiple media streams are transmitted over standardized interfaces, then more content can be delivered, but the interfaces require high computational power to process and merge streams
Solution Approach 1:
The streams are pre-processed and packaged into a multiplexed bitstream structure before transmission. The auxiliary media stream is embedded and synchronized with the main audio stream in advance, so that the reproduction system receives a ready-to-play stream that requires minimal real-time processing and merging operations.
3Productivity
If auxiliary streams are embedded in the main stream, then processing efficiency improves, but legacy devices may not recognize additional packets
Solution Approach 1:
The packet structure is designed with differentiated properties: each packet contains type identification information that allows devices to recognize and process only the packet types they support. Legacy devices can ignore packets with unknown types while modified decoders can process both main stream packets and auxiliary stream packets based on their capabilities.
4Manufacturing precision
If time-alignment and gain control are implemented for synchronized reproduction, then audio-visual synchronization improves, but the system complexity increases
Solution Approach 1:
Time-alignment information and gain control parameters are pre-calculated and embedded in the packet headers during the multiplexing stage. The reproduction system simply needs to read and apply these pre-computed values without performing complex real-time calculations, achieving precise synchronization with minimal processing overhead.
Data Source
AI summary
The disclosure relates to methods, apparatus and systems for side load processing of packetized media streams. In an embodiment, the apparatus comprises: a receiver for receiving a bitstream, and a splitter for identifying a packet type in the bitstream and splitting, based on the identification of a value of the packet type in the bit stream into a main stream and an auxiliary stream.