SEI Confidence Signaling for Progressive and Interlaced Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding and decoding technologies face challenges in accurately determining the source type and characteristics of video content, particularly when faced with limited information or computational resources, leading to difficulties in processing interlaced and progressive content effectively.
Innovation Solution
Incorporating supplemental enhancement information (SEI) messages with confidence levels and flags to indicate the accuracy of picture source data, allowing decoders to make informed decisions on processing interlaced, progressive, or mixed content, even when the encoder has limited information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the encoder includes detailed picture source data in SEI messages, then the decoder can accurately determine picture characteristics, but the bitstream size increases
Solution Approach 1:
The patent extracts only the essential picture source data characteristics (progressive/interlaced scan type, duplicate picture status) and places them in SEI messages, rather than transmitting complete picture source information. This selective extraction maintains decoding accuracy while minimizing bitstream overhead.
Solution Approach 2:
The patent changes the representation of picture source data from detailed comprehensive information to condensed parameter indicators (flags and syntax elements). By encoding picture characteristics as discrete parameters rather than full data sets, the bitstream size is reduced while preserving the necessary information for accurate decoding.
2Reliability
If the encoder provides comprehensive picture source information, then the decoder can make accurate processing decisions, but the complexity of the encoding system increases
Solution Approach 1:
The encoder extracts only the critical picture source characteristics needed for decoder processing decisions, rather than analyzing and transmitting all available picture source information. This reduces the computational burden and complexity of the encoder system while maintaining reliable decoding.
Solution Approach 2:
The patent applies partial action by providing only the necessary subset of picture source information (progressive/interlaced flags, duplicate picture indicators) rather than complete analysis. This partial information suffices for the decoder to make accurate processing decisions without requiring the encoder to perform exhaustive analysis.
3Measurement precision
If the decoder performs separate identification of progressive or interlaced pictures, then processing accuracy improves, but the decoding time increases
Solution Approach 1:
The encoder performs preliminary identification of picture source characteristics (progressive or interlaced scan type) and encodes this information in SEI messages before transmission. The decoder receives pre-identified picture type information, eliminating the need for time-consuming separate identification and enabling immediate appropriate processing.
Solution Approach 2:
The patent implements a feedback mechanism where the encoder analyzes picture source characteristics and provides this information back to the decoder through SEI messages. This feedback loop allows the decoder to use the encoder's identification results rather than performing independent analysis, reducing decoding time while maintaining accuracy.
Data Source
AI summary
This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.