Video Coding Illuminance-Based Optical Flow Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video coding techniques have low coding efficiency, and existing optical flow based coding methods do not effectively handle illuminance changes, which affects coding performance.
Innovation Solution
A method that determines whether to apply optical flow based coding to a video unit based on illuminance information, adjusting the coding process by considering illuminance changes and using tools like local illumination compensation and bi-prediction with CU-level weights to refine prediction blocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If optical flow based coding method is applied without considering illuminance information, then coding complexity is reduced, but coding precision deteriorates due to illuminance changes affecting prediction accuracy
Solution Approach 1:
The patent changes the parameter of optical flow calculation by introducing illuminance information as an additional constraint. The optical flow is recalculated or adjusted based on illuminance changes between reference and current frames, allowing the system to maintain coding precision under varying lighting conditions while avoiding the full complexity of traditional illumination compensation methods
Solution Approach 2:
Illuminance information serves as an intermediary between the reference frame and current frame in the optical flow calculation. By using illuminance data as a mediator, the system can account for lighting changes without requiring complex illumination compensation algorithms, thus maintaining precision while controlling complexity
2Device complexity
If conventional video coding techniques are used, then device complexity is low, but productivity deteriorates due to low coding efficiency
Solution Approach 1:
The patent enhances conventional video coding by introducing illuminance information as an additional parameter in the prediction process. This parameter change allows the system to maintain relatively simple device architecture while significantly improving coding efficiency through better prediction accuracy in varying lighting conditions
3Ease of operation
If optical flow based coding method is applied without illuminance consideration, then ease of operation is maintained, but measurement precision deteriorates in terms of motion estimation accuracy under illuminance changes
Solution Approach 1:
The patent performs preliminary calculation of illuminance information before the optical flow based coding process. By pre-computing illuminance data and using it to guide the optical flow calculation, the system maintains ease of operation while improving motion estimation accuracy, as the illuminance guidance prevents erroneous flow calculations in regions with significant lighting changes
Data Source
AI summary
Embodiments of the present disclosure provide a solution for video processing is proposed. A method for video processing is proposed. The method comprises: determining, during a conversion between a video unit and a bitstream of the video unit, whether an optical flow based coding method is applied to the video unit based on illuminance information associated with at least one of: the video unit or a reference video unit of the video unit; and performing the conversion based on the determination. Compared with the conventional solution, the proposed method can advantageously improve the coding efficiency and performance.