Video Bitstream Parameter Set Ordering for Adaptive Resolution Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies struggle with efficiently managing changes in picture size and resolution within a coded video sequence, particularly in modern standards like VVC, which require complex signaling mechanisms for adaptive resolution changes (ARC) that can impact efficiency and complexity.
Innovation Solution
The proposed method involves decoding a coded video bitstream by obtaining and utilizing a sequence parameter set (SPS) before a picture parameter set (PPS) and picture header (PH) network abstraction layer (NAL) unit, allowing for flexible and efficient signaling of adaptive resolution changes (ARC) through various parameter sets and headers, optimizing the decoding process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If complex signaling mechanisms are used for adaptive resolution changes in VVC, then flexibility in resolution changes is improved, but decoding complexity increases
Solution Approach 1:
The patent segments the resolution change signaling into multiple independent parameter sets (SPS and PPS) with distinct functionalities. SPS handles sequence-level resolution parameters while PPS handles picture-level parameters, allowing independent processing and reducing overall decoding complexity while maintaining flexibility.
Solution Approach 2:
The patent performs preliminary action by establishing the SPS before the PPS in the decoding process. The SPS is decoded first to set up sequence-level parameters, and then the PPS is decoded to override or supplement with picture-specific parameters. This preliminary structuring reduces complexity by providing a clear hierarchical framework.
2Adaptability or versatility
If multiple parameter sets are used for adaptive resolution changes, then resolution flexibility is improved, but processing overhead increases
Solution Approach 1:
The patent applies local quality by allowing the PPS to override specific parameters in the SPS on a picture-by-picture basis. Instead of transmitting complete parameter sets for every picture, only the picture-specific overrides are signaled in the PPS, reducing processing overhead while maintaining resolution flexibility where needed.
Solution Approach 2:
The patent introduces dynamics by enabling optional overriding of SPS parameters by PPS parameters. The decoder can dynamically select whether to use SPS defaults or PPS overrides based on the presence and content of PPS data, optimizing processing overhead based on actual resolution change requirements.
3Adaptability or versatility
If reference picture resampling is performed for different resolutions, then adaptability to varying picture sizes is improved, but computational complexity increases
Solution Approach 1:
The patent performs preliminary action by pre-defining reference picture parameters and resolution configurations in the SPS before actual decoding occurs. This allows the decoder to prepare resolution adaptation mechanisms in advance, reducing computational complexity during real-time decoding while maintaining adaptability to varying picture sizes.
Solution Approach 2:
The patent applies parameter changes by allowing resolution parameters to be modified between SPS and PPS levels. The SPS establishes base resolution parameters, and the PPS can override specific parameters for individual pictures, enabling efficient parameter adaptation without full recomputation and reducing overall computational complexity.
Data Source
AI summary
A method of decoding an encoded video bitstream using at least one processor, including obtaining a coded video sequence from the encoded video bitstream; obtaining a picture unit from the coded video sequence; obtaining a PH NAL unit included in the picture unit; obtaining at least one coded slice NAL unit included in the picture unit; decoding a coded picture based on the PH NAL unit, the at least one coded slice NAL unit a PPS NAL unit obtained from the coded video sequence, and am SPS NAL unit obtained from the coded video sequence; and outputting the decoded picture, wherein the SPS NAL unit is available to the at least one processor before the PPS NAL unit, and wherein the PPS NAL unit is available to the at least one processor before the PH NAL unit and the at least one coded slice NAL unit.