Frame-Level Illumination Compensation for Lower Video Coding Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The use of illumination compensation technology in video coding leads to an increase in bit rate due to overhead flags at the coding unit level, particularly in normal natural videos where illumination compensation is not necessary, affecting coding efficiency.
Innovation Solution
An adaptive illumination compensation method that enables or disables the technology at the frame level based on the video sequence, using flags to determine when to apply illumination compensation, thereby optimizing bitstream efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If illumination compensation technology is applied at the coding unit level, then illumination changes and shadow changes are eliminated, but bit rate increases due to overhead flags
Solution Approach 1:
The patent segments the illumination compensation application from the coding unit level to the frame level. By introducing a frame-level illumination compensation enabled flag, the system determines whether to apply illumination compensation across the entire frame rather than at individual coding unit level, thereby reducing the overhead flags and bit rate while maintaining compensation effectiveness for frames with significant illumination changes
Solution Approach 2:
The patent applies illumination compensation partially by enabling it only at the frame level rather than universally at all coding unit levels. This selective application allows the system to benefit from illumination compensation where needed (frames with illumination changes) while avoiding the overhead cost in frames where it is not necessary, optimizing the balance between compensation effectiveness and bit rate
2Reliability
If illumination compensation is applied to all frames, then illumination changes are compensated, but coding efficiency decreases for normal natural videos
Solution Approach 1:
The patent introduces dynamic control of illumination compensation through a frame-level enabled flag that can be set or cleared based on the specific frame characteristics. This dynamic mechanism allows the system to adaptively enable illumination compensation only when necessary (e.g., frames with significant illumination changes) and disable it for normal natural videos, thereby optimizing coding efficiency while maintaining compensation effectiveness when needed
Solution Approach 2:
The system incorporates feedback through the frame-level illumination compensation enabled flag, which is determined based on frame characteristics such as illumination changes and shadow changes. This feedback mechanism allows the encoder to assess whether illumination compensation is beneficial for each frame and make an informed decision, preventing unnecessary overhead in frames where compensation is not needed and maintaining coding efficiency
Data Source
AI summary
An illumination compensation method, an encoder, and a decoder are provided in implementations of the disclosure. A bitstream is obtained, and the bitstream is parsed to obtain an illumination compensation enabled flag. An illumination compensation frame-level enabled flag in the bitstream is obtained, when the illumination compensation enabled flag is valid. An illumination compensation usage flag in the bitstream is obtained, when the illumination compensation frame-level enabled flag is valid. Index information of a target illumination compensation mode in the bitstream is obtained, when the illumination compensation usage flag is valid. Illumination compensation is performed on a current block based on the index information of the target illumination compensation mode.