Error-Resilient Illumination Compensation in 3D Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multi-view video coding technologies face parsing dependency issues with illumination compensation, leading to errors when inter-view and temporal reference pictures are used together, causing parsing problems due to indirect dependencies and transmission errors.
Innovation Solution
The solution involves incorporating an illumination compensation flag only for coding units processed as 2Nx2N prediction units and disabling it for units with multiple prediction sizes, and deriving the flag from selected merging candidates in Merge mode, ensuring robust error resilience without impacting system performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If illumination compensation is applied with indirect parsing dependency on reference pictures, then coding efficiency is improved, but error resilience deteriorates due to transmission errors affecting parsing
Solution Approach 1:
The patent extracts and removes the indirect parsing dependency on reference pictures by introducing a direct ic_flag syntax element in the coding unit header. This flag is independently parsed without relying on reference picture information, thereby eliminating the error propagation path while maintaining illumination compensation functionality.
Solution Approach 2:
The ic_flag acts as an intermediary element that mediates between the need for illumination compensation and the requirement for error resilience. By using this explicit flag, the system avoids the harmful indirect dependency on reference pictures while still enabling IC when needed.
2Reliability
If illumination compensation flag is incorporated for all coding units, then error resilience is improved, but bitrate increases due to additional syntax elements
Solution Approach 1:
The patent applies local quality by making the ic_flag incorporation conditional on the prediction unit type. The flag is only incorporated for 2Nx2N prediction units, which are the most common and benefit most from illumination compensation, rather than forcing it on all coding units. This selective approach maintains error resilience where needed while minimizing bitrate overhead.
Solution Approach 2:
The patent uses partial action by applying the error-resilient ic_flag mechanism only to 2Nx2N prediction units rather than all coding units. This partial application achieves the essential error resilience goal while avoiding excessive bitrate increase that would result from universal application.
3Adaptability or versatility
If illumination compensation is enabled for multiple prediction unit sizes, then coding flexibility is improved, but device complexity increases due to parsing variations
Solution Approach 1:
The patent segments the coding unit based on prediction unit size, applying the ic_flag syntax only to 2Nx2N PUs. This segmentation simplifies the parsing logic by creating a clear distinction between PU types that require the flag and those that don't, thereby reducing overall parsing complexity while maintaining necessary flexibility.
Solution Approach 2:
Instead of making the complex case (multiple PU sizes) the default and adding exceptions, the patent inverts the approach by making the simple case (2Nx2N PU with ic_flag) the standard and treating other PU sizes as exceptions that don't require the flag. This inversion simplifies the overall system design.
Data Source
Figure 1A~1B
Figure 2
Figure 3
AI summary
A method of illumination compensation for three-dimensional or multi-view encoding and decoding. The method incorporates an illumination compensation flag only if the illumination compensation is enabled and the current coding unit is processed by one 2Nx2N prediction unit. The illumination compensation is applied to the current coding unit according to the illumination compensation flag. The illumination compensation flag is incorporated when the current coding unit is coded in Merge mode without checking whether a current reference picture is an inter-view reference picture.