Video Bitstream Interweaving for Legacy Parser Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding and decoding technologies face challenges in efficiently aggregating and separating independent video bitstreams due to the introduction of additional overhead when multiplexing NAL units into M4Mux packets, leading to issues with parsing and storage in file formats like ISOBMFF.
Innovation Solution
An interweaving method that determines an interweaving pattern to combine independent bitstreams into a single interweaved bitstream, using interweaving units, and optionally signals this pattern through SEI messages, allowing for efficient aggregation and subsequent deinterweaving.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple independent video bitstreams are multiplexed into M4Mux packets, then aggregation capability is improved, but parsing complexity and storage compatibility deteriorate
Solution Approach 1:
The patent segments the aggregated bitstream into distinct interweaving units, each containing metadata identifiers that mark the boundaries and origins of different source bitstreams. This segmentation allows legacy parsers to process each unit independently without needing to understand the complex multiplexing structure, thus reducing parsing complexity while maintaining aggregation capability.
Solution Approach 2:
The patent introduces an interweaving unit as an intermediary structure between the multiplexed bitstreams and legacy parsers. This intermediary contains metadata that bridges the gap between the complex aggregated structure and the simple expected input format of legacy parsers, enabling compatibility without requiring changes to existing parsing algorithms.
2Adaptability or versatility
If multiple independent video bitstreams are multiplexed into M4Mux packets, then aggregation capability is improved, but storage compatibility deteriorates
Solution Approach 1:
By segmenting the aggregated bitstream into interweaving units with clear metadata markers, the patent enables storage systems to handle each unit as a discrete, compatible entity. This segmentation allows the aggregated bitstream to be stored in existing file formats without requiring new storage infrastructure or compatibility layers.
Solution Approach 2:
The patent applies local quality by inserting metadata identifiers only at specific boundaries within the bitstream where needed, rather than transforming the entire structure. This localized modification preserves compatibility with existing storage systems while enabling aggregation functionality where required.
3Ease of operation
If interweaving units with metadata are inserted into bitstreams, then deinterweaving capability is improved, but bitstream overhead increases
Solution Approach 1:
The patent applies partial action by inserting metadata identifiers only at necessary boundaries within the bitstream, rather than adding comprehensive metadata throughout. This selective approach provides sufficient information for deinterweaving operations while minimizing the overhead added to the bitstream.
Solution Approach 2:
The patent changes the parameter of metadata density by using compact identifier formats and inserting them only at critical boundaries rather than continuously. This parameter adjustment maintains deinterweaving capability while reducing the overall overhead proportion in the bitstream.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention provides a method of aggregate at least a first bitstream and a second bitstream into an interweaved bitstream, the method comprising: determining an interweaving pattern; determine one or more first interweaving unit(s) and one or more second interweaving unit(s),wherein the one or more first interweaving unit(s) is used for the first bitstream, the one or more second interweaving unit(s) is used for the second bitstream; writing the one or more first interweaving unit(s) and the second interweaving unit to the interweaved bitstream.