SEI Processing Order Signaling in Video Bitstreams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards, such as VVC, face challenges in signaling the preferred processing order for Supplemental Enhancement Information (SEI) messages, particularly due to limitations in the syntax and semantics of the SEI processing order SEI message, which can lead to operational problems and lack of clarity.
Innovation Solution
The proposed solution involves requiring that the SEI processing order SEI message contains at least two entries for both the SEI payload type and processing order syntax elements, ensuring that a relative processing order among multiple types of SEI messages can be signaled. Additionally, treating a zero value for the processing order as similar to a one value simplifies the processing order semantics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the SEI processing order SEI message contains only a single entry for payload type and processing order, then the syntax structure is simple, but the ability to signal relative processing order among multiple SEI message types is insufficient
Solution Approach 1:
The SEI processing order SEI message is segmented into multiple entries, where each entry contains a payload type value and an associated processing order value. This allows the system to signal processing orders for multiple different SEI message types within a single SEI processing order message, resolving the contradiction between signaling capability and syntax simplicity.
2Adaptability or versatility
If the SEI processing order SEI message contains multiple entries for payload type and processing order, then the signaling of relative processing order among multiple SEI message types is improved, but the syntax and semantics become more complex
Solution Approach 1:
The SEI processing order SEI message structure is designed to be universal, where a repeated syntax structure (entries containing payload type and processing order values) can handle multiple SEI message types. This multi-functional approach allows the same syntax framework to signal processing orders for various SEI message types without requiring separate syntax definitions for each type, thereby managing complexity while enhancing signaling capability.
3Reliability
If a zero value for processing order is treated differently from a one value, then special cases can be handled, but the processing order semantics become less clear and more operationally problematic
Solution Approach 1:
The patent establishes homogeneous treatment of processing order values, where a zero value is interpreted identically to a one value (both indicating that the SEI message should be processed as early as possible). This homogenization eliminates special case handling requirements, clarifies the semantics, and improves operational clarity while maintaining reliability in SEI message processing.
Data Source
AI summary
A mechanism for processing video data is disclosed. A conversion is performed between a visual media data and a bitstream based on a rule that includes a bitstream conformance requirement which requires that a supplemental enhancement information (SEI) processing order SEI message shall contain a SEI payload type syntax element with at least a first entry and a second entry.