SEI Message for Decoder Picture-Based Parallelization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video decoding technologies require deep analysis of bitstreams to identify independently decodable pictures, which is inefficient and hinders parallelization of decoding processes.
Innovation Solution
Incorporating a Supplementary Enhancement Information (SEI) message that indicates picture independence, allowing decoders to identify and decode pictures independently without requiring deep bitstream analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If deep bitstream analysis is performed to identify independently decodable pictures, then decoding accuracy is improved, but decoding speed and parallelization capability deteriorate
Solution Approach 1:
The SEI message is inserted into the bitstream in advance to declare picture independence information. This allows the decoder to know beforehand which pictures can be decoded independently, eliminating the need for deep analysis during decoding and enabling immediate parallelization decisions.
Solution Approach 2:
The SEI message acts as an intermediary that carries picture independence information from the encoder to the decoder. This intermediary structure provides a standardized, easily parseable mechanism for conveying decoding dependency information without requiring complex bitstream analysis.
2Measurement precision
If deep bitstream analysis is performed to identify independently decodable pictures, then decoding accuracy is improved, but computational resources required worsen
Solution Approach 1:
Picture independence information is prepared in advance by the encoder and embedded in SEI messages. This preliminary preparation shifts the computational burden to the encoding stage, allowing the decoder to simply read and act on the pre-computed independence declarations without performing complex analysis.
Solution Approach 2:
The SEI message serves as an intermediary data structure that efficiently encapsulates picture independence information. This standardized format reduces the computational complexity of identifying independent pictures compared to analyzing the full bitstream structure.
3Productivity
If SEI message with picture independence indication is used, then parallel decoding capability is improved, but device complexity worsens
Solution Approach 1:
The decoding process is segmented into independent picture decoding tasks based on SEI message indications. Each independent picture can be assigned to a separate decoder instance, dividing the overall decoding workload into manageable, non-dependent segments that can be processed simultaneously.
Solution Approach 2:
The SEI message structure is designed to be universally applicable across different picture types and coding configurations. The same SEI message mechanism works for various picture formats and dependency patterns, reducing the need for specialized handling logic in the decoder.
Data Source
AI summary
A method and apparatus comprising computer code configured to cause a processor or processors to obtain video data including at least a first coded picture and a second coded picture, identify, by a decoder, at least one syntax element in a supplementary information enhancement (SEI) message indicating that the second coded picture is to be decoded independently from the first picture, and decode the second coded picture independently from the first coded picture based on the at least one syntax element in the SEI message.