SEI Message Parameter Set Activation for Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards, such as HEVC, face challenges in efficiently indicating and activating multiple active sequence parameter sets (SPSs) within a bitstream, particularly in multiview and scalable video coding scenarios, where multiple SPSs are needed to decode video data effectively.
Innovation Solution
Incorporating multiple SPS IDs into an SEI message, such as an active parameter sets SEI message or buffering period SEI message, to enable a video decoder to activate and decode multiple SPSs and a video parameter set (VPS) based on the included identifiers, facilitating multiview and scalable video coding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple SPS identifiers are included in an SEI message, then the ability to indicate and activate multiple active parameter sets is improved, but the complexity of the SEI message structure increases
Solution Approach 1:
The SEI message is segmented into multiple syntax elements: a first syntax element indicating the number of additional SPS identifiers, and multiple second syntax elements providing the actual SPS identifiers. This segmentation allows the message to scale flexibly with the number of SPSs while maintaining structured organization.
Solution Approach 2:
The patent introduces a numerical dimension (first syntax element specifying count) before the list of SPS identifiers (second syntax elements). This dimensional approach to signaling allows efficient encoding of variable numbers of SPS identifiers without requiring complex variable-length encoding for each possible count.
2Adaptability or versatility
If multiple SPS identifiers are signaled in the SEI message, then support for multiview and scalable video coding is improved, but the bitstream overhead increases
Solution Approach 1:
The patent uses a fixed first syntax element to indicate the number of additional SPS identifiers, followed by that many second syntax elements. This approach provides exact signaling for the required number of SPSs without excessive overhead, while the structure can accommodate any number of SPSs needed for multiview or scalable coding scenarios.
3Productivity
If multiple SPSs are activated through SEI message referencing, then decoding efficiency for multiple layers or views is improved, but the complexity of the decoding process increases
Solution Approach 1:
The SEI message provides advance indication of all active SPS identifiers before the video data is decoded. This preliminary signaling allows the decoder to pre-configure the necessary decoding parameters and data structures for multiple SPSs, improving decoding efficiency when the actual video data is processed.
Solution Approach 2:
The decoder uses the SPS identifiers from the SEI message to activate the appropriate SPSs and VPS, creating a feedback loop where the signaled identifiers directly control the decoding configuration. This ensures that the decoder operates with the correct parameter sets for multiview or scalable video coding.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In some examples, a video encoder includes multiple sequence parameter set (SPS) IDs in an SEI message, such that multiple active SPSs can be indicated to a video decoder. In some examples, a video decoder activates a video parameter set (VPS) and/or one or more SPSs through referencing an SEI message, e.g., based on the inclusion of the VPS ID and one or more SPS IDs in the SEI message. The SEI message may be, as examples, an active parameter sets SEI message or a buffering period SEI message.