Supplemental SPS NAL Unit for Layer-Dependent Video Parameters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards face challenges in efficiently transmitting layer-dependent information across multiple layers, particularly when base layers and composite temporal layers share header information, leading to inefficiencies and compatibility issues in decoding processes.
Innovation Solution
The introduction of a supplemental Sequence Parameter Set (SPS) Network Abstraction Layer (NAL) unit with a different structure than the standard SPS NAL unit, allowing for separate transmission of layer-dependent information for additional layers, enabling efficient decoding and compatibility across various video coding standards like AVC, SVC, and MVC.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If base layers and composite temporal layers share header information in existing video coding standards, then device complexity is reduced, but decoding efficiency and compatibility deteriorate due to inefficiencies in transmitting layer-dependent information
Solution Approach 1:
The patent segments the Sequence Parameter Set (SPS) information into two distinct structures: a standard SPS NAL unit containing base layer parameters, and a supplemental SPS NAL unit containing layer-dependent parameters for additional layers. This segmentation allows each unit to serve its specific purpose efficiently, resolving the contradiction between simplified structure and decoding efficiency.
Solution Approach 2:
The patent extracts layer-dependent information from the shared header structure and places it in a separate supplemental SPS NAL unit. This extraction enables selective transmission of necessary parameters for each layer without forcing all layers to process unnecessary overhead information, thereby improving decoding efficiency while maintaining structural simplicity.
2Ease of operation
If a unified SPS NAL unit structure is used for all layers, then ease of operation is improved, but adaptability to different terminal capabilities deteriorates
Solution Approach 1:
The patent introduces dynamic adaptability by allowing terminals to selectively process different NAL unit types based on their capabilities. The supplemental SPS NAL unit provides dynamic parameter adjustment for different layers, enabling the system to adapt to varying terminal capabilities while maintaining a straightforward decoding process for each terminal type.
Solution Approach 2:
The standard SPS NAL unit serves as a universal base for all layers, while the supplemental SPS NAL unit provides additional functionality for enhanced layers. This multi-functional approach allows a single decoding framework to handle both basic and advanced terminal capabilities universally.
3Measurement precision
If layer-dependent information is transmitted for all layers, then decoding precision is improved, but loss of information increases due to overhead transmission
Solution Approach 1:
The patent extracts only the necessary layer-dependent parameters into the supplemental SPS NAL unit, rather than transmitting complete parameter sets for all layers. This selective extraction maintains decoding precision for each layer while minimizing overhead information transmission.
Solution Approach 2:
The patent applies local quality by providing detailed layer-dependent parameters only where needed (in supplemental SPS for specific layers) while using shared base parameters for common aspects. This localized approach ensures decoding precision is maintained for each layer's specific requirements without unnecessary overhead.
Data Source
Figure 1
Figure 1a
Figure 2
AI summary
In an implementation, a supplemental sequence parameter set ("SPS") structure is provided that has its own network abstraction layer ("NAL") unit type and allows transmission of layer-dependent parameters for non-base layers in an SVC environment. The supplemental SPS structure also may be used for view information in an MVC environment. In a general aspect, a structure is provided that includes (1) information (1410) from an SPS NAL unit, the information describing a parameter for use in decoding a first-layer encoding of a sequence of images, and (2) information (1420) from a supplemental SPS NAL unit having a different structure than the SPS NAL unit, and the information from the supplemental SPS NAL unit describing a parameter for use in decoding a second-layer encoding of the sequence of images. Associated methods and apparatuses are provided on the encoder and decoder sides, as well as for the signal.