SEI Confidence Levels for Mixed Progressive and Interlaced Frames

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video encoding and decoding technologies face challenges in accurately determining the source type and characteristics of video content, particularly when faced with limited computational resources or mixed progressive and interlaced content, leading to suboptimal processing and display of video frames.

Innovation Solution

Incorporating supplemental enhancement information (SEI) messages with confidence levels and flags to indicate the accuracy of picture source data, such as progressive or interlaced scan, and the presence of mixed characteristics, allowing decoders to make informed processing decisions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If video encoding systems use compression to reduce bit rate, then storage and transmission costs decrease, but the ability to accurately preserve and convey picture source data characteristics (progressive/interlaced scan type) deteriorates

Engineering Contradiction:

Improvestorage and transmission costVSAvoidpicture source data accuracy

Core Design Contradiction:

Loss of energyVSLoss of information

Solution Approach 1:

The patent introduces SEI (Supplemental Enhancement Information) messages as an intermediary mechanism that carries picture source data characteristics separately from the compressed video bitstream. These messages include confidence level indicators that mediate between the encoder's knowledge of source characteristics and the decoder's need to accurately interpret them, without requiring increased compression of the main video data

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the video information transmission into two separate channels: the compressed video bitstream and supplemental enhancement information messages. This segmentation allows the source characteristics (progressive/interlaced scan type) and their confidence levels to be conveyed independently from the video content, preserving information accuracy while maintaining compression efficiency

Inventive Principle:

Principle #1Segmentation

2Measurement precision

If decoders attempt to independently identify picture scan type (progressive or interlaced), then display accuracy may improve, but processing complexity and computational resources increase

Engineering Contradiction:

Improvepicture scan type identification accuracyVSAvoiddecoder processing complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by having the encoder pre-determine and encode the picture source data characteristics (scan type) and confidence levels into SEI messages before transmission. This allows the decoder to receive ready-made information about progressive/interlaced characteristics without needing to perform complex independent analysis, reducing decoder complexity while maintaining accuracy

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The confidence level indicator acts as a feedback mechanism that informs the decoder about the reliability of the encoded picture source data characteristics. This feedback allows the decoder to adjust its processing accordingly - trusting encoder-provided information when confidence is high, and potentially performing independent analysis when confidence is low, thus optimizing the balance between accuracy and complexity

Inventive Principle:

Principle #23Feedback

3Adaptability or versatility

If encoders provide detailed picture source data information in SEI messages, then decoder flexibility improves, but bitstream size and transmission overhead increase

Engineering Contradiction:

Improvedecoder processing flexibilityVSAvoidbitstream size

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent uses parameter changes by encoding confidence levels as discrete numerical values (e.g., 0-3 scale) rather than continuous data, and using compact syntax elements in SEI messages. This allows detailed information about picture source characteristics to be conveyed with minimal bit overhead, maintaining decoder flexibility while controlling bitstream size

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS12563203B2Supplemental enhancement information including confidence level and mixed content information

Publication Date: 2026.02.24 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.