Video Decoding SEI Processing Order for Guided Post-Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The challenge in video coding lies in determining the optimal order for applying multiple supplemental enhancement information (SEI) messages for post-processing, as the intended result may vary based on the content provider's design, and some processes are dependent on prior steps, leading to complexity issues and inefficiencies.
Innovation Solution
A system and method for video decoding and encoding that utilizes processing order information to define subsets of SEI messages, including unique identifiers and indicators for understanding the order and complexity, allowing for flexible and efficient processing based on client capabilities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple SEI messages are applied for post-processing, then video quality can be improved through various processing steps, but the complexity of determining the correct processing order increases
Solution Approach 1:
The encoder performs preliminary action by embedding processing order information in the bitstream before transmission. This allows the decoder to automatically determine the correct processing sequence without complex runtime analysis, resolving the contradiction between achieving high video quality through multiple SEI messages and maintaining low system complexity.
2Ease of operation
If SEI messages are processed in appearance order, then processing is simple, but the result may not match the content provider's intended outcome
Solution Approach 1:
Processing order information acts as an intermediary between the content provider's intent and the decoder's execution. This intermediary carries the authoritative sequencing instructions from encoder to decoder, ensuring that the processing result accurately reflects the content provider's intention while maintaining processing simplicity through automated instruction following.
3Reliability
If processing order information is embedded in the bitstream, then the correct processing sequence can be ensured, but the bitstream size increases
Solution Approach 1:
The patent employs parameter changes by using compact syntax elements and efficient coding schemes for processing order information. Instead of transmitting full processing descriptions, only essential ordering parameters are embedded, achieving reliable processing order transmission while minimizing bitstream size through optimized data representation.
Data Source
AI summary
An apparatus for video decoding receives a video data stream having pictures of a video encoded thereinto. The video data stream comprises a plurality of access units, a plurality of SEI (supplemental enhancement information) messages and processing order information which defines a processing order of the plurality of SEI messages. The apparatus is configured to determine the processing order information to obtain information on the processing order of the plurality of SEI messages. The processing order information comprises information on an identifier for each SEI message of two or more SEI messages of the plurality of SEI messages, wherein the identifier of each SEI message of the two or more SEI messages is unique among the two or more SEI messages. The apparatus is configured to decode a current AU using inter-picture prediction from a referenced reference picture stored in the DPB to acquire a decoded picture, and to insert the decoded picture into the DPB, assign to each reference picture stored in the DPB a classification as one of a short-term reference picture, a long-term reference picture and an unused-for-reference picture, read DPB mode information from the current AU, if the DPB mode information indicates a first mode, remove one or more reference pictures classified as a short-term picture, according to a first-in-first-out (FIFO) strategy, from the DPB, if the DPB mode information indicates a second mode, read memory management control information comprising at least one command in the current AU and process the at least one command so as to change the classification assigned to at least one of the reference pictures stored in the DPB, and use the classification of the reference pictures in the DPB, for managing reference picture removal from the DPB.