Video Slice Header Syntax Optimization for Inter-Layer Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The increasing popularity of digital media poses challenges in efficiently representing, storing, and rapidly playing back high-quality content, particularly in electronic devices that require improved decoding methods for video bitstreams to enhance performance.
Innovation Solution
A method for decoding video from a bitstream that involves decoding multiple pictures across different layers with shared temporal time, where each slice is decoded independently, using information from the video parameter set extension syntax and slice segment header syntax to derive active and direct reference layers, and signaling inter-layer prediction indicators.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple layers with multiple reference pictures are used to improve video quality, then the video quality is improved, but the decoding complexity and memory requirements increase
Solution Approach 1:
The patent divides the reference picture management into separate layers, where each layer has its own reference picture list. This segmentation allows the decoder to process each layer independently with its own reference pictures, reducing the overall complexity compared to managing all reference pictures in a single large structure. The syntax elements num_direct_ref_layers and num_active_ref_pic_lists_per_layer enable granular control over reference picture allocation per layer.
Solution Approach 2:
The patent introduces a new dimensional organization for reference pictures by adding the layer dimension. Instead of a flat reference picture structure, reference pictures are now organized in a multi-dimensional space with layers as one dimension and picture lists as another. This is achieved through syntax elements like direct_ref_layer[i] which specify the layer index for each reference picture, allowing efficient memory addressing and access patterns.
2Reliability
If independent slice decoding is implemented to improve error resilience and parallel processing, then error resilience is improved, but the overhead for managing reference layers across slices increases
Solution Approach 1:
The patent segments the video picture into independent slices that can be decoded in parallel. Each slice has its own slice segment header that independently specifies the number of active reference layer pictures and direct reference layers. This segmentation enables error isolation where errors in one slice do not propagate to other slices, while the independent header information minimizes the overhead of managing reference layers across multiple slices.
3Productivity
If inter-layer prediction is used to improve compression efficiency, then the compression efficiency is improved, but the signaling overhead increases
Solution Approach 1:
The patent implements partial inter-layer prediction by introducing a flag syntax element (inter_layer_prediction_layer_indicator) that selectively enables or disables inter-layer prediction on a per-slice basis. This partial application of inter-layer prediction allows the system to achieve compression benefits where needed while avoiding the signaling overhead in regions where inter-layer prediction is not beneficial, thus optimizing the trade-off between compression efficiency and signaling overhead.
Data Source
AI summary
This invention introduces modification to a syntax signaled in slice segment header related to inter-layer prediction. A syntax optimization is proposed where if syntax element NumActiveRefLayerPics is equal to syntax element NumDirectRefLayers[nuh_layer_id] then the inter_layer_pred_idc[i] syntax elements are not signaled. In this case the value of inter_layer_pred_idc[i] syntax elements is inferred based on other syntax elements already signaled.