Video Coding Syntax Element Signaling for Mixed NAL Units
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards face challenges in efficiently signaling syntax elements, particularly in scenarios with mixed NAL unit types within a picture, leading to redundant signaling and potential decoding errors.
Innovation Solution
The proposed method involves setting specific syntax elements in the picture parameter set (PPS) and picture header (PH) to indicate the presence of multiple NAL units and their types, ensuring consistent signaling and avoiding redundant information, thereby improving bitstream conformance and decoding accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If syntax elements are signaled in both PPS and PH independently, then each header can be optimized separately, but redundant signaling occurs and bitstream consistency deteriorates
Solution Approach 1:
The patent merges the signaling of syntax elements related to NAL unit types and picture structure into a unified framework where the PPS syntax element `pps_same_nalu_type_in_pic_flag` and PH syntax element `gdr_or_irap_pic_flag` are coordinated through shared constraints and dependencies. This ensures that signaling in one header is consistent with the other, eliminating redundant or conflicting information while maintaining optimization flexibility.
Solution Approach 2:
The patent implements feedback mechanisms where the value of `gdr_or_irap_pic_flag` in the PH depends on the value of `pps_same_nalu_type_in_pic_flag` in the PPS. This cross-header feedback ensures that the picture header signaling is consistent with the parameter set signaling, preventing bitstream errors while allowing independent optimization of each header structure.
2Adaptability or versatility
If mixed NAL unit types are allowed in a picture, then video coding versatility improves, but decoding complexity and error potential increase
Solution Approach 1:
The patent introduces dynamic control mechanisms where the decoder behavior adapts based on the values of `pps_same_nalu_type_in_pic_flag` and `gdr_or_irap_pic_flag`. When these flags indicate mixed NAL unit types, the decoder dynamically adjusts its processing mode to handle different NAL unit types appropriately, maintaining versatility while managing complexity through conditional logic rather than always-maximal complexity handling.
Solution Approach 2:
The patent applies local quality control by allowing different NAL unit types in different regions or contexts within a picture, controlled by the syntax elements. Instead of requiring uniform handling across the entire picture, the decoder applies specific processing rules locally based on the NAL unit type indicators, reducing overall decoding complexity while maintaining support for mixed types where needed.
3Reliability
If redundant syntax signaling is used, then decoding robustness improves, but bit rate efficiency deteriorates
Solution Approach 1:
The patent applies partial redundancy signaling where only the necessary syntax elements are signaled in each header based on the picture configuration. Instead of always signaling all possible parameters in both PPS and PH, the system signals only what is needed given the values of `pps_same_nalu_type_in_pic_flag` and `gdr_or_irap_pic_flag`, achieving robustness through targeted redundancy rather than excessive signaling.
Data Source
AI summary
A method for video coding is provided. The method includes: setting, by an encoder, a first syntax element in a picture parameter set (PPS) specifying whether a picture corresponding to the PPS comprises more than one network abstraction layer (NAL) units and whether the more than one NAL units have a same NAL unit type; setting, by the encoder, a second syntax element in a picture header (PH) specifying whether the picture corresponding to the PH is an intra random access point (IRAP) picture or a gradual decoding refresh (GDR) picture, where a value of the second syntax element is set based on a value of the first syntax element; and forming, by the encoder, a bitstream with the first syntax element and the second syntax element.