Video Coding Parameter Set Placement for ISOBMFF Interoperability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The inconsistency in defining 'random access points' across different implementations of the ISOBMFF leads to interoperability issues, where video coders may fail to accurately determine the conditions for parameter set placement, resulting in files being rejected or not played back correctly.
Innovation Solution
Updating the constraints on parameter set placement in AVC, SVC, MVC, and HEVC file formats to align with the ISOBMFF standards, ensuring that parameter set data for sync and non-sync samples is encoded and decoded based on specific conditions, such as being included in the sample entry, a previous sync sample, or samples between the non-sync sample and the previous sync sample in decoding order.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If parameter set data is placed flexibly in various locations in the bitstream, then coding efficiency is improved, but interoperability deteriorates due to inconsistency in defining random access points across different implementations
Solution Approach 1:
The patent segments the video bitstream into distinct samples with clear classifications (sync samples vs. non-sync samples). This segmentation allows parameter set data to be placed in specific, well-defined locations relative to these sample types, ensuring both coding efficiency and interoperability. The sync sample acts as a reference point that divides the bitstream into manageable segments with predictable parameter set placement.
Solution Approach 2:
The patent requires that parameter set data be placed in advance at specific locations (in the sample entry, in the sample itself, or in previous sync samples) before the actual video sample needs to be decoded. This preliminary placement ensures that decoders can reliably find and use the parameter set data without ambiguity, resolving the interoperability issue while maintaining coding efficiency.
2Productivity
If parameter set placement constraints are relaxed to improve coding efficiency, then file rejection issues occur due to inaccurate determination of parameter set placement conditions
Solution Approach 1:
The patent applies different placement rules to different types of samples. Sync samples have specific requirements (parameter sets must be in the sample entry or sample itself), while non-sync samples have different rules (parameter sets can be in the sample entry, sample, previous sync sample, or samples between the non-sync sample and previous sync sample). This localized quality approach ensures placement accuracy for each sample type while maintaining overall coding efficiency.
3Adaptability or versatility
If parameter set data is stored in multiple possible locations, then coding flexibility is improved, but decoding reliability deteriorates due to uncertainty in retrieving the correct parameter set data
Solution Approach 1:
The patent implements a feedback mechanism where the decoder determines the sample type (sync or non-sync) and uses this information to selectively search for parameter set data in the appropriate locations. This feedback-driven approach ensures that despite multiple possible storage locations, the decoder reliably retrieves the correct parameter set data by following the placement rules associated with the identified sample type.
Data Source
AI summary
File formats and parsing and coding of video data are defined to promote more efficient random accessibility of coded video data. Constraints may be imposed on placement of parameter sets and the definition of sync samples in video files. Parameter set data for video data may be coded, for a non-sync sample, only in the sample entry for the sample, the sample, a previous sample in decoding order that is a sync sample, or in a sample occurring in decoding order between the sample and the previous sample in decoding order that is a sync sample.