Video Coder Illumination Compensation Signaling Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video coding, particularly in 3D-HEVC, the signaling of illumination compensation mode is redundant when advanced residual prediction is used, leading to unnecessary bit waste and inefficiency, as these modes are not performed together, and the control of illumination compensation usage is at the slice level, resulting in inefficient bitstream management.
Innovation Solution
A method where the illumination compensation syntax element is skipped when an advanced residual prediction weighting factor is non-zero, indicating the use of advanced residual prediction, and signaled only when the weighting factor is zero, allowing the video coder to determine whether to use illumination compensation based on the weighting factor value.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If illumination compensation syntax element is always signaled, then illumination compensation can be applied, but bit waste occurs due to redundant signaling when advanced residual prediction is used
Solution Approach 1:
The patent applies dynamics by making the signaling of illumination compensation syntax elements conditional rather than static. The syntax element is only signaled when the ARP weighting factor equals zero, creating a dynamic signaling mechanism that adapts to the prediction mode being used, thereby eliminating redundant bits while ensuring illumination compensation is applied when necessary
Solution Approach 2:
The patent changes the parameter of syntax element signaling from always-present to conditionally-present based on the ARP weighting factor value. This parameter change optimizes the bitstream by including illumination compensation syntax elements only when ARP is not used (weighting factor = 0), reducing overall bit consumption while maintaining functional reliability
2Ease of operation
If illumination compensation syntax element is signaled for every block, then complete control is maintained, but bitstream efficiency decreases due to unnecessary signaling
Solution Approach 1:
The patent extracts the illumination compensation syntax element signaling from the universal block-level signaling and removes it for blocks where ARP is used (weighting factor ≠ 0). This extraction eliminates unnecessary signaling overhead while preserving the ability to control illumination compensation where it is actually needed, thereby improving bitstream efficiency without sacrificing operational control
Solution Approach 2:
The signaling behavior is made dynamic based on the ARP weighting factor. When the weighting factor is non-zero (indicating ARP usage), the illumination compensation syntax element is omitted. When the weighting factor is zero, the syntax element is signaled. This dynamic approach optimizes bitstream efficiency while maintaining ease of operation where required
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In one example, a device for coding (e.g., encoding or decoding) video data includes a memory configured to store video data and a video coder configured to determine a value for an advanced residual prediction (ARP) weighting factor of a current block of the video data and to skip coding of an illumination compensation syntax element for the current block and to code the current block when the value of the ARP weighting factor is not equal to zero. The video coder may further be configured to code the illumination compensation syntax element for the current block and code the current block based at least in part on the value of the illumination compensation syntax element when the value of the ARP weighting factor is equal to zero.