Video Coding Sublayer Conformance via BP SEI Scope Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video coding systems face challenges in efficiently encoding and decoding multi-layer bitstreams due to inconsistencies in sequence parameter sets (SPSs) across different layers, leading to unexpected errors and increased resource usage.
Innovation Solution
The proposed solution involves modifying the Buffering Period Supplemental Enhancement Information (BP SEI) message to indicate the number of layers/sublayers for conformance checking, using a bp_max_sublayers_minus1 syntax element, and ensuring consistency across layers by setting it to a value within the range of the VPS maximum sublayers minus one (vps_max_sublayers_minus1), thereby avoiding layer-based coding errors and reducing resource usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conformance checking is performed on all layers/sublayers in multi-layer bitstreams, then decoding reliability is improved, but processor and memory resource usage increases
Solution Approach 1:
The patent segments the multi-layer bitstream into distinct layers and sublayers, allowing conformance checking to be performed selectively on specific segments rather than uniformly on all layers. The bp_max_sublayers_minus1 parameter enables the system to divide the checking scope into manageable portions, reducing the overall computational burden while maintaining reliability where needed.
Solution Approach 2:
The patent implements partial conformance checking by allowing the bp_max_sublayers_minus1 parameter to specify a subset of layers/sublayers for checking. This partial action approach checks only the necessary portions of the bitstream rather than performing exhaustive checking on all layers, thereby reducing processor and memory resource usage while still ensuring decoding reliability for critical layers.
2Adaptability or versatility
If sequence parameter sets (SPSs) are used to contain syntax elements for each video sequence in multi-layer videos, then adaptability to different layers is improved, but inconsistencies across layers cause unexpected errors
Solution Approach 1:
The patent creates a universal conformance checking mechanism that works across all layers and sublayers through the bp_max_sublayers_minus1 parameter. This universal approach ensures that regardless of layer-specific SPS variations, the conformance checking process remains consistent and reliable, eliminating the errors caused by SPS inconsistencies while maintaining adaptability to different layer configurations.
Solution Approach 2:
The patent introduces the bp_max_sublayers_minus1 parameter as a new control variable that changes the behavior of conformance checking based on the specific multi-layer configuration. By adjusting this parameter, the system can adapt the checking scope to match the actual layer structure, ensuring reliable operation across different layer configurations without being constrained by SPS inconsistencies.
3Manufacturing precision
If the number of layers/sublayers for conformance checking is increased, then coding accuracy is improved, but network resource usage increases
Solution Approach 1:
The patent makes the conformance checking scope dynamic through the bp_max_sublayers_minus1 parameter, which can be adjusted based on network conditions and requirements. This dynamic approach allows the system to increase checking accuracy when network resources are abundant and reduce the checking scope when network resources are constrained, optimizing the balance between coding accuracy and network resource usage.
Solution Approach 2:
The patent implements partial conformance checking by allowing bp_max_sublayers_minus1 to specify only the necessary number of layers/sublayers for checking rather than checking all layers. This partial action approach achieves sufficient coding accuracy for the given network conditions without unnecessarily increasing network resource usage, allowing flexible adaptation to different network capacities.
Data Source
AI summary
A video coding mechanism is disclosed. The mechanism includes encoding a bitstream comprising a video parameter set (VPS) and one or more sublayers. A buffering period (BP) supplemental enhancement information (SEI) message comprising a BP maximum sublayers minus one (bp_max_sublayers_minus1) is also encoded into the bitstream. The bp_max_sublayers_minus1 is set to a value in a range of zero to a maximum number of sublayers indicated in the VPS. A hypothetical reference decoder (HRD) is initialized based on the BP SEI message. A set of bitstream conformance tests are performed on the sublayers. The bitstream is stored for communication toward a decoder.