Slice Header Reference Marking for Scalable Video Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression technologies struggle to adapt to flexible network environments with varying bandwidths, necessitating improved scalability and extraction methods for layered bit streams.
Innovation Solution
A method of decoding video information that involves receiving a bit stream, parsing NALU headers, and marking decoded pictures as reference or non-reference pictures based on slice headers, while utilizing SEI messages for active parameter sets, to enhance scalability information representation and adaptive transformation at the packet level.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If nal_ref_flag is included in NALU header to indicate reference picture status, then picture reference management is simplified, but bit stream overhead increases
Solution Approach 1:
The reference picture status indication is extracted from the NALU header and relocated to the slice header. This removes the overhead from the NALU header while preserving the reference management functionality through the slice header's reference picture list structures.
Solution Approach 2:
The slice header acts as an intermediary structure that carries reference picture status information. Instead of directly indicating reference status in the NALU header, the system uses the slice header's existing reference picture list mechanisms (ref_list_0, ref_list_1) to convey the same information more efficiently.
2Adaptability or versatility
If scalability information is represented flexibly for various bit streams, then adaptability to network conditions improves, but system complexity increases
Solution Approach 1:
The slice header structures (ref_list_0, ref_list(1)) are designed to serve multiple functions: they manage reference picture status for prediction algorithms while simultaneously providing scalability information for layered bit stream extraction. This multi-functionality achieves flexibility without adding separate dedicated structures.
Solution Approach 2:
The system uses parameter flags (used_by_curr_pic_flag, inter_layer_pred_flag) within existing slice header structures to dynamically indicate different operational modes. By changing the state of these parameters, the system can represent different scalability scenarios without increasing structural complexity.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods and systems are provided. One aspect of the present disclosure relates to a video decoding method comprising: parsing a network abstraction layer (NAL) unit header of an NAL unit comprising information related to encoded video; decoding a first picture; marking the first picture as a reference picture; storing the first picture, which is marked as the reference picture, to a decoded picture buffer (DPB); parsing a slice header of a second picture which is the next picture of the first picture in a decoding order. The method further comprises re-marking the first picture as a reference picture or a non-reference picture based on reference picture information comprised in a slice header of the second picture, wherein the NAL unit header corresponding to the NAL unit comprising encoded data of the first picture does not comprise information indicating whether the first picture is a reference picture or a non-reference picture in the NAL unit.