Video Bitstream Signaling for Decoder Alignment With Encoder Optimizations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies do not effectively signal optimization techniques applied by encoders for machine scenarios, leading to potential mismatches and inefficiencies in decoding processes.
Innovation Solution
Implementing signaling techniques in video bitstreams using Supplementary Enhancement Information (SEI) messages to indicate the use, no-use, and unknown states of optimization techniques such as ROI, foreground, and background pre-processing, allowing decoders to adapt accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If optimization techniques are applied by the encoder for machine scenarios, then video encoding efficiency is improved, but the decoder cannot adapt to these optimizations leading to decoding inefficiency
Solution Approach 1:
The encoder sends feedback information about the applied optimization techniques through SEI messages in the video bitstream. This feedback includes syntax elements that indicate which optimizations (e.g., ROI, foreground, background pre-processing) were used, allowing the decoder to adapt its processing accordingly.
Solution Approach 2:
The encoder performs optimization techniques as preliminary actions before encoding, and signals these optimizations in advance through SEI messages. This allows the decoder to prepare appropriate processing strategies before actually decoding the video data, improving overall system efficiency.
2Adaptability or versatility
If detailed signaling information is included in the bitstream to indicate optimization states, then decoder adaptability is improved, but bitstream complexity increases
Solution Approach 1:
The signaling information is segmented into separate SEI messages rather than being embedded throughout the bitstream. Each SEI message contains specific syntax elements about particular optimization techniques, allowing the decoder to process only relevant information without parsing the entire bitstream for optimization details.
Solution Approach 2:
The system signals only the necessary optimization information through optional SEI messages rather than requiring complete detailed signaling for all possible optimizations. The three-state syntax elements (used, no-use, unknown) provide sufficient information without excessive detail, balancing adaptability with bitstream simplicity.
Data Source
AI summary
A method includes receiving a coded video bitstream comprising coded information of one or more pictures, and determining a signaled value of a syntax element from the coded video bitstream. The syntax element is associated with a use state of an optimization technique for encoding the one or more pictures into the coded video bitstream by an encoder, the syntax element is structured to have at least three possible values corresponding to three use states of the optimization technique, a first value of the syntax element indicates an unknown state of the optimization technique for encoding the one or more pictures, a second value of the syntax element indicates a used state of the optimization technique for encoding the one or more pictures, and a third value of the syntax element indicates a no-use state of the optimization technique for encoding the one or more pictures.