Re-sampling SEI Message for Video Bitstream Signaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards lack efficient signaling of down-sampling information within bitstreams, making it difficult for decoders to accurately determine and perform up-sampling, leading to suboptimal video reconstruction quality.
Innovation Solution
Incorporating a re-sampling SEI message in the bitstream to indicate whether and how down-sampling is performed on video units, including flags, ratios, and methods, such as discrete cosine transform-based interpolation, bilinear, or learning-based methods, to enable accurate up-sampling and reconstruction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If down-sampling information is not signaled in the bitstream, then the bitstream structure remains simple, but the decoder cannot accurately determine up-sampling parameters leading to poor video reconstruction quality
Solution Approach 1:
The patent introduces a re-sampling SEI message as an intermediary carrier that conveys down-sampling information between the encoder and decoder. This SEI message acts as a mediator that provides the necessary down-sampling parameters (flags, ratios, methods) without altering the core video data structure, thus resolving the contradiction between information completeness and data integrity.
2Reliability
If down-sampling information is added to the bitstream, then accurate up-sampling can be performed, but the bitstream complexity increases
Solution Approach 1:
The patent segments the down-sampling information into a separate SEI (Supplemental Enhancement Information) message that is independent from the main video bitstream. This segmentation allows the down-sampling parameters to be conveyed without complicating the core video data structure, maintaining bitstream simplicity while providing reliable up-sampling information.
Solution Approach 2:
The re-sampling SEI message serves as an intermediary layer that carries down-sampling information separately from the main video stream. This intermediary approach enables accurate up-sampling guidance without integrating complex information into the base bitstream, thus avoiding unnecessary structural complexity.
3Measurement precision
If comprehensive down-sampling information (flags, ratios, methods) is signaled, then up-sampling can be performed accurately, but the bitstream size increases
Solution Approach 1:
The patent applies partial action by signaling only the essential down-sampling parameters needed for accurate up-sampling (flags indicating whether down-sampling occurred, re-sampling ratios, and method types). This selective signaling approach provides sufficient precision for up-sampling operations without unnecessarily increasing bitstream data volume with redundant information.
Data Source
AI summary
A video processing method includes determining information included in a bitstream that indicates whether down-sampling is performed on a video unit, and performing a conversion between the video unit and the bitstream based on the bitstream.