Multiple Local Illumination Compensation Models for Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding models, such as JVET and VVC, rely on a single linear prediction model for Local Illumination Compensation (LIC) across entire Coding Units, which can lead to inaccuracy due to varying illumination changes.
Innovation Solution
Implementing multiple local illumination compensation models for each Coding Unit, using a least squares calculation and considering neighboring pixels to determine appropriate scaling and offset values, allowing for more accurate prediction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single linear prediction model is used for Local Illumination Compensation across the entire Coding Unit, then the device complexity is reduced and ease of manufacture is improved, but the measurement precision and reliability of illumination compensation deteriorate
Solution Approach 1:
The patent divides the Coding Unit into multiple sub-regions, each with its own linear prediction model parameters (scaling factor and offset). This segmentation allows each sub-region to be compensated for illumination changes independently, improving overall accuracy while keeping each local model simple.
Solution Approach 2:
The patent applies different prediction model parameters to different local regions within the Coding Unit. By determining separate scaling factors and offsets for each sub-region based on local neighboring pixels, the system achieves locally optimized illumination compensation that adapts to varying illumination conditions across different parts of the block.
2Reliability
If multiple local illumination compensation models are implemented for each Coding Unit, then the measurement precision and reliability improve, but the device complexity and processing overhead increase
Solution Approach 1:
The Coding Unit is segmented into multiple sub-regions, each processed with its own prediction model. This segmentation improves reliability by capturing local illumination variations while maintaining manageable complexity through systematic processing of each segment.
Solution Approach 2:
The patent changes the parameters (scaling factor and offset) of the linear prediction model based on the specific characteristics of each local region. By adapting these parameters to local conditions using neighboring pixels, the system achieves higher reliability without requiring a completely different model structure.
3Loss of information
If a single linear prediction model is used across the entire Coding Unit, then the ease of operation and processing speed are maintained, but the loss of information increases due to inaccurate prediction
Solution Approach 1:
Dividing the Coding Unit into sub-regions reduces prediction error by ensuring each segment uses parameters appropriate for its local illumination characteristics, thereby reducing information loss while maintaining a relatively simple segmented processing approach.
Solution Approach 2:
By applying locally adapted prediction parameters to different regions, the system minimizes prediction error and information loss in each local area, achieving better overall accuracy while keeping the local processing operations simple and straightforward.
Data Source
AI summary
A method is provided for inter-coding video in which coding units can be encoded using multiple local illumination compensation (LIC) values to more accurately and efficiently transmit and render video. In the method, two or more LIC values can be established for a single coding unit (CU) such that the CU can be coded using multiple LIC values instead of a single LIC value as employed in present systems.