Inter-layer Video Illumination Compensation for Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video codecs face challenges in efficiently encoding and decoding high-resolution or high-quality video content, particularly in managing illumination differences between inter-layer images, which affects encoding efficiency and data transmission amounts.

Innovation Solution

An inter-layer video encoding and decoding method that determines whether to perform illumination compensation based on image characteristics, specifically for blocks of a predetermined partition type and prediction mode, using inter-layer prediction information and reference blocks to adjust illumination and reduce residual prediction, thereby optimizing encoding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If illumination compensation is performed for all blocks in inter-layer video encoding, then video quality is improved, but calculation load and encoding complexity increase

Engineering Contradiction:
Improvevideo qualityVSAvoidencoding complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies illumination compensation selectively only to blocks that exhibit significant illumination differences between layers, rather than uniformly to all blocks. The encoder determines whether to apply illumination compensation on a per-block basis by comparing reference blocks and evaluating illumination characteristics, thereby improving video quality where needed while reducing unnecessary computational overhead in blocks where illumination compensation is not beneficial.

Inventive Principle:
Principle #3Local quality

2Productivity

If illumination compensation is performed for all blocks, then coding efficiency is improved, but data transmission amount increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoiddata transmission amount
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent transmits illumination compensation parameters only for blocks where illumination differences are detected, rather than transmitting data for all blocks. The encoder identifies blocks requiring compensation and transmits relevant parameters (such as illumination compensation factors) only for those specific blocks, thereby improving coding efficiency for problematic areas while minimizing the increase in data transmission amount.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies illumination compensation partially rather than universally - it performs compensation only to the extent necessary for blocks with significant illumination differences. By using a threshold-based approach and selective application, the patent achieves sufficient coding efficiency improvement without the excessive data transmission that would result from applying compensation to all blocks without distinction.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If illumination compensation is applied selectively based on block characteristics, then calculation load is reduced, but video quality may deteriorate in compensated blocks

Engineering Contradiction:
Improvecalculation loadVSAvoidvideo quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent incorporates a feedback mechanism where the encoder evaluates illumination characteristics of reference blocks and determines whether illumination compensation should be applied based on detected differences. The system continuously assesses illumination conditions and adjusts compensation application accordingly, ensuring that video quality is maintained in blocks where compensation is beneficial while avoiding quality degradation in blocks where compensation is not appropriate. This feedback-driven approach optimizes the balance between calculation load and video quality.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9877020B2Method for encoding inter-layer video for compensating luminance difference and device therefor, and method for decoding video and device therefor
Publication Date: 2018.01.23 SAMSUNG ELECTRONICS CO LTD
  • US9877020B2 patent drawing
  • US9877020B2 patent drawing
  • US9877020B2 patent drawing

AI summary

Provided are an inter-layer video encoding method and apparatus therefor and an inter-layer video decoding method and apparatus therefor. An inter-layer video decoding method involves reconstructing a first layer image, based on encoding information obtained from a first layer bitstream; in order to reconstruct a second layer block determined as a predetermined partition type and to be in a prediction mode, determining whether to perform illumination compensation for the reconstructed second layer block determined by using a first layer reference block that is from among the reconstructed first layer image and corresponds to the second layer block; and generating the reconstructed second layer block by using inter-layer prediction information obtained from a second layer bitstream and the first layer reference block, and generating a second layer image including the reconstructed second layer block whose illumination is determined according to whether the illumination compensation was performed.