Video Bitstream Signaling for Field Order and Frame Repetition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video compression and decompression standards lack efficient mechanisms for signaling field display order and frame repetition, leading to limitations in bitstream elements for interlaced and progressive video content, particularly in scenarios requiring pull-down conversions.
Innovation Solution
The implementation of a bitstream format with additional syntax elements such as a pull-down flag, interlaced content flag, repeat-picture elements, and field-order elements allows for explicit signaling of field display order and repetition, enabling more flexible and efficient encoding and decoding of interlaced and progressive video content, including pull-down conversions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If additional syntax elements (pull-down flag, interlaced content flag, repeat-picture elements, field-order elements) are added to the bitstream format, then signaling efficiency for field display order and frame repetition is improved, but bitstream complexity increases
Solution Approach 1:
The patent segments the bitstream into multiple syntax layers (sequence layer, picture layer, slice layer, macroblock layer) and places different signaling elements at appropriate layers. This allows efficient organization of information without overwhelming complexity at any single layer, resolving the contradiction between comprehensive signaling and bitstream simplicity.
Solution Approach 2:
The patent introduces conditional syntax elements that are only present when needed (e.g., pull-down flag only when pull-down conversion is applied, interlaced content flag only for interlaced video). This dynamic inclusion/exclusion based on content requirements improves signaling efficiency while avoiding unnecessary complexity in sequences that don't require these features.
2Adaptability or versatility
If repeat-picture elements are included in the bitstream for every picture, then display repetition control is improved, but bitrate increases
Solution Approach 1:
The patent extracts the repeat-picture signaling from being a mandatory element for every picture and makes it conditional. The repeat-picture element is only included when actual repetition is needed, allowing flexible control where necessary while avoiding unnecessary bitrate consumption in sequences without repetition requirements.
Solution Approach 2:
The patent allows the decoder to discard repeat-picture elements when they are not present in the bitstream (defaulting to no repetition), and only processes them when explicitly provided. This selective handling reduces bitrate by eliminating redundant signaling while maintaining the capability for display repetition control when needed.
3Adaptability or versatility
If field-order elements are signaled for every picture, then field display order control is improved, but processing overhead increases
Solution Approach 1:
The patent implements dynamic field-order signaling where the field-order element is only present in the bitstream when field display order needs to be explicitly controlled. For sequences with default or unchanged field ordering, the element is omitted, reducing processing overhead while maintaining adaptability when needed.
Solution Approach 2:
The patent creates a universal syntax structure where the same bitstream framework handles both progressive and interlaced content, with field-order elements being part of the general syntax but only activated when interlaced content requires explicit field ordering control. This multi-functional approach improves versatility without proportionally increasing processing overhead.
Data Source
AI summary
A decoder processes a first bitstream element (e.g., a pull-down flag) in a first syntax layer (e.g., sequence layer or entry point layer) above frame layer in a bitstream for a video sequence, the bitstream comprising encoded source video having a source type (e.g., progressive or interlace). The decoder processes frame data in a second syntax layer (e.g., frame layer) of the bitstream for a frame (such as an interlaced frame or progressive frame, depending on source type, or a skipped frame) in the video sequence. The first bitstream element indicates whether a repeat-picture element (e.g., a repeat-frame element or a repeat field-element) is present or absent in the frame data in the second syntax layer.