Local Illumination Compensation for Video Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding and decoding methods struggle with efficiently addressing illumination variations across frames, leading to suboptimal compression efficiency and increased complexity.

Innovation Solution

The implementation of a local illumination compensation (LIC) method that applies a linear function to predicted samples, where the function parameters are determined based on selected reference samples, to compensate for illumination changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If existing video encoding and decoding methods are used, then the processing complexity and memory bandwidth requirements are reduced, but the compression efficiency deteriorates due to inability to handle illumination variations

Engineering Contradiction:
Improvecompression efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the video processing into distinct stages: prediction stage, illumination compensation stage, and residual coding stage. The illumination compensation is applied locally to specific blocks using separate linear functions for different regions, allowing independent optimization of each segment without increasing overall system complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The illumination compensation is performed preliminarily on the predicted samples before the residual calculation and encoding stages. By pre-compensating for illumination variations in the prediction step, the method reduces the complexity of subsequent processing stages and improves compression efficiency without adding significant overall complexity

Inventive Principle:
Principle #10Preliminary action

2Productivity

If illumination compensation is applied to handle illumination variations, then the compression efficiency is improved, but the processing complexity and memory bandwidth requirements increase

Engineering Contradiction:
Improvecompression efficiencyVSAvoidprocessing pipeline complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies local illumination compensation where different linear functions are used for different spatial blocks. Each block's illumination characteristics are compensated independently using locally adapted parameters, which improves compression efficiency for regions with varying illumination while keeping the processing complexity localized and manageable

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The method changes the parameters of the prediction model by introducing illumination compensation parameters (linear function coefficients) that are derived from reference samples. These parameter changes allow the system to adapt to illumination variations without fundamentally changing the overall processing pipeline architecture

Inventive Principle:
Principle #35Parameter changes

3Productivity

If illumination compensation is applied to handle illumination variations, then the compression efficiency is improved, but the memory bandwidth requirements increase

Engineering Contradiction:
Improvecompression efficiencyVSAvoidmemory bandwidth
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent extracts only the necessary reference samples from the reference picture that are needed for illumination compensation parameter calculation. By selecting and using only the relevant samples rather than processing entire blocks or frames, the method reduces memory bandwidth requirements while maintaining compression efficiency

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The method applies partial illumination compensation by using a subset of available reference samples and applying compensation only where illumination variations are detected. This partial action approach improves compression efficiency for affected regions without requiring full processing of all picture data, thus reducing overall memory bandwidth requirements

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20250159183A1Method and device for picture encoding and decoding using illumination compensation
Publication Date: 2025.05.15 INTERDIGITAL MADISON PATENT HLDG
  • US20250159183A1 patent drawing
  • US20250159183A1 patent drawing
  • US20250159183A1 patent drawing

AI summary

A method for reconstructing a picture block is disclosed, wherein the block is predicted using local illumination compensation. The parameters of local illumination compensation parameters are determined according a selection of reconstructed samples located to the left and above the current block. In the case where some of them are unavailable, they may be replaced by others, using different techniques.