SEI Message Priority Ordering for Consistent Video Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards, such as AVC, HEVC, and VVC, do not define the processing order of Supplemental Enhancement Information (SEI) messages, leading to variations in video output depending on the order of processing these messages, which can affect the final video quality and compliance with creative intent.
Innovation Solution
Implementing a priority processing order for SEI messaging by specifying the order of metadata processing through high-level syntax elements in the video bitstream, such as in the video parameter set, picture parameter set, or sequence parameter set, to ensure consistent and accurate rendering of video content.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If no processing order is defined for SEI messages, then the video coding standards remain simple and flexible, but the video output varies depending on processing order, affecting video quality and creative intent
Solution Approach 1:
The patent applies preliminary action by defining the processing order of SEI messages in advance through syntax elements in the video bitstream (such as in VPS, PPS, or SPS). This pre-definition ensures that decoders process SEI messages in a consistent order, eliminating variations in video output while maintaining standard simplicity through structured syntax definitions.
2Reliability
If processing order is defined for all SEI messages, then video output consistency is improved, but the syntax complexity and processing overhead increase
Solution Approach 1:
The patent applies local quality by making the processing order definition selective rather than universal. Syntax elements are introduced that allow the encoder to specify processing order only for SEI messages where it matters, while other messages can be processed in default order. This reduces processing overhead while maintaining video output consistency for critical messages.
Solution Approach 2:
The patent introduces new syntax parameters (such as sei_message_priority or processing_order indicators) that change the state of SEI message processing from unordered to ordered. These parameter changes are embedded in the bitstream structure, allowing decoders to adjust their processing behavior based on the specified parameters without requiring complete redefinition of the processing pipeline.
Data Source
AI summary
Methods, systems, and bitstream syntax are described for determining the processing order of metadata messaging, such as supplemental enhancement information (SEI) messaging in MPEG video coding.


