Multi-Model Local Illumination Compensation for Video Blocks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding systems struggle with efficiently addressing illumination variations within video blocks, leading to suboptimal compression and decoding performance.
Innovation Solution
Implementing local illumination compensation (LIC) with multiple linear models by dividing video blocks into sub-partitions and deriving separate LIC parameter sets for each sub-partition, allowing for more precise illumination modeling and improved encoding/decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single LIC parameter set is used for the entire current block, then the device complexity is reduced, but the illumination variation compensation precision deteriorates
Solution Approach 1:
The current block is divided into multiple sub-partitions (e.g., two sub-partitions), and separate LIC parameter sets are derived for each sub-partition based on their respective templates. This segmentation allows the illumination variation to be modeled more precisely in different regions while keeping the computational complexity manageable through localized processing.
Solution Approach 2:
Different LIC parameter sets are applied to different sub-partitions of the current block, allowing each region to have optimized illumination compensation parameters tailored to its local characteristics. This ensures that areas with different illumination variations receive appropriate compensation without being constrained by a single global parameter set.
2Reliability
If multiple LIC parameter sets are derived for sub-partitions, then the video quality is improved, but the encoding complexity increases
Solution Approach 1:
The current block is divided into multiple sub-partitions, and separate LIC parameter sets are derived for each sub-partition based on their respective templates. This segmentation allows the illumination variation to be modeled more precisely in different regions while keeping the computational complexity manageable through localized processing.
Solution Approach 2:
Instead of applying full complexity illumination compensation to the entire block, the method applies simplified LIC processing to each sub-partition independently. This partial action approach achieves sufficient video quality improvement without the excessive computational burden of a more complex global compensation method.
3Measurement precision
If sub-partition-based LIC is implemented, then the illumination modeling accuracy is improved, but the processing time increases
Solution Approach 1:
The current block is divided into multiple sub-partitions, and separate LIC parameter sets are derived for each sub-partition based on their respective templates. This segmentation allows the illumination variation to be modeled more precisely in different regions while keeping the computational complexity manageable through localized processing.
Solution Approach 2:
Templates associated with each sub-partition are identified and prepared in advance, allowing the LIC parameter sets to be derived efficiently during the encoding/decoding process. This preliminary preparation of template information reduces the actual processing time required for illumination compensation.
Data Source
AI summary
Systems, methods, and instrumentalities are disclosed for performing local illumination compensation (LIC) with multiple linear models. In an example, a device, such as a video decoding device, or a video encoding device, may determine that sub-partition-based local illumination compensation (sub-LIC) is enabled for a current block. The device may divide the current block into a plurality of sub-partitions. The device may identify a plurality of templates associated with the plurality of sub-partitions. The device may derive a plurality of local illumination compensation (LIC) parameter sets associated with the plurality of sub-partitions based on the plurality of templates associated with the plurality of sub-partitions. The device may process (e.g., encode and/or decode) the current block based on the plurality of LIC parameter sets.