Video Prediction Refinement with Local Illumination Compensation for IBC

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video coding technologies, such as MPEG-2, MPEG-4, ITU-T.263, ITU-T.264/MPEG-4 AVC, and ITU-T.265 HEVC, require further improvements in coding efficiency, particularly in intra block copy (IBC) processes.

Innovation Solution

Implementing a refinement process to derive a refined prediction sample for video units, enhancing the conversion between video units and bitstreams, and applying local illumination compensation (LIC) to improve coding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional video coding technologies (MPEG-2, MPEG-4, AVC, HEVC) are used, then video compression is achieved, but coding efficiency is insufficient

Engineering Contradiction:

Improvecoding efficiencyVSAvoidprediction accuracy

Core Design Contradiction:

ProductivityVSLoss of information

Solution Approach 1:

The patent applies local illumination compensation by changing the parameters of the prediction sample through linear transformation (scaling factor alpha and offset beta). This transforms the prediction sample to better match the current block's illumination characteristics, thereby improving prediction accuracy and coding efficiency without requiring fundamentally new coding structures.

Inventive Principle:

Principle #35Parameter changes

2Productivity

If prediction samples are refined using local illumination compensation, then coding efficiency is improved, but computational complexity increases

Engineering Contradiction:

Improvecoding efficiencyVSAvoidprocessing complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The patent applies local illumination compensation specifically to prediction samples in regions where illumination variation is detected, rather than uniformly processing all blocks. By selectively applying the refinement process based on local characteristics (comparing template blocks and determining whether LIC parameters should be applied), the patent improves coding efficiency for problematic regions while avoiding unnecessary computation in regions that don't require refinement.

Inventive Principle:

Principle #3Local quality

3Measurement precision

If a refinement process is applied to prediction samples, then prediction accuracy is improved, but processing time increases

Engineering Contradiction:

Improveprediction accuracyVSAvoidprocessing time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies local illumination compensation selectively rather than universally. The refinement process is applied only to prediction samples where it is determined to be beneficial (based on template matching and LIC parameter application decisions), rather than applying the full refinement process to all prediction samples. This partial application reduces the overall processing time while still achieving improved prediction accuracy where needed.

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS20250254357A1Method, apparatus, and medium for video processing

Publication Date: 2025.08.07 DOUYIN VISION CO LTD

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: deriving, for a conversion between a video unit of a video and a bitstream of the video, a prediction sample of the video unit; deriving a refined prediction sample of the video unit by applying a refinement process to the prediction sample; and performing the conversion based on the refined prediction sample.