Video Coding Sign Harmonization for SBH and Residual Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for harmonizing Multiple Sign Bit Hiding (MSBH) and Residual Sign Prediction (RSP) in video coding standards like H.265/HEVC suffer from reduced coding efficiency due to adverse effects when MSBH modifies signs of coefficients that can be correctly predicted by RSP, leading to suboptimal compression performance.
Innovation Solution
A method is introduced to separate the RSP procedure into two sub-procedures, with SBH performed between these sub-procedures, and coefficients for SBH are deliberately selected to avoid inclusion in RSP lists, using a predetermined function to embed signs and minimize distortion, ensuring correct prediction and efficient entropy coding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If MSBH modifies signs of coefficients to embed sign bits, then coding efficiency is improved through sign bit hiding, but coding efficiency deteriorates when coefficients that can be correctly predicted by RSP are modified, leading to suboptimal compression performance
Solution Approach 1:
The patent segments the set of transform coefficients into two distinct groups: a first set of coefficients whose signs are embedded using MSBH, and a second set of coefficients whose signs are predicted using RSP. This segmentation allows each method to operate on appropriate subsets without interfering with the other, resolving the contradiction by ensuring that coefficients suitable for prediction are not modified by sign bit hiding.
Solution Approach 2:
The patent extracts coefficients suitable for sign bit hiding from the overall set of transform coefficients, separating them from coefficients that should be used for residual sign prediction. By taking out the appropriate subset for MSBH processing, the method prevents modification of coefficients that would compromise RSP accuracy, thus maintaining both coding efficiency and prediction reliability.
2Productivity
If MSBH is applied to all non-zero coefficients, then sign bit hiding is maximized, but incorrect sign predictions occur when coefficients are modified before RSP processing
Solution Approach 1:
The patent divides transform coefficients into distinct sets: a first set for MSBH processing and a second set for RSP processing. This segmentation ensures that sign bit hiding is applied only to coefficients where it is appropriate, while preserving sign information accuracy for coefficients that will be used for prediction.
Solution Approach 2:
The patent performs preliminary identification and separation of coefficients into appropriate sets before applying either MSBH or RSP. This preliminary action prevents subsequent incorrect modifications or predictions by establishing the correct processing order and coefficient allocation in advance.
3Ease of manufacture
If the order of SBH and RSP operations is not optimized, then implementation is simplified, but coding efficiency deteriorates due to adverse effects of sign modification
Solution Approach 1:
The patent segments the processing workflow into distinct stages: first separating coefficients into appropriate sets, then applying MSBH to the first set, and finally applying RSP to the second set. This segmented approach maintains implementation simplicity while achieving optimized coding efficiency through proper operation ordering.
Solution Approach 2:
The patent performs preliminary separation of coefficients into distinct sets before applying the respective operations. This preliminary action simplifies the overall implementation by establishing clear processing stages, while simultaneously optimizing coding efficiency by preventing adverse interactions between the two operations.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention relates to an improved apparatus and method for harmonizing both Sign Bit Hiding (SBH) and Residual Sign Prediction (RSP) techniques in video coding. In order to improve coding efficiency, a list of transform coefficients, to which RSP is to be applied is prepared in advance of selecting a coefficient to which SBH is applied. Thereby, the RSP list can be populated in such a manner that the highest coding efficiency may be expected. Subsequently, one or more coefficients for applying SBH are selected so as not to be included in the list.