Subblock Local Illumination Compensation for Video Encoding Pipelines
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression systems face challenges in optimizing the decoding pipeline for Local Illumination Compensation (LIC) due to the unavailability of neighboring samples in a pipelined processing architecture, leading to delays and compromised performance.
Innovation Solution
The method involves determining refined linear model parameters for each subblock based on available spatially neighboring reconstructed samples and corresponding reference samples, allowing LIC to be applied iteratively as motion information becomes available, thereby improving the accuracy and compatibility with pipelined subblock-based motion compensation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If pipelined subblock-based motion compensation is used to improve processing speed, then productivity increases, but the availability of neighboring samples for LIC is compromised, worsening measurement precision
Solution Approach 1:
The patent divides the block into multiple subblocks and processes them in parallel pipelines. Each subblock is processed independently with its own LIC parameters, allowing simultaneous computation across multiple subblocks. This segmentation enables pipelined processing that maintains both speed and accuracy by computing LIC parameters for each subblock based on available neighboring samples without waiting for the entire block to be processed.
Solution Approach 2:
The patent performs preliminary computation of LIC parameters for each subblock as motion information becomes available during pipelined processing. Instead of waiting for complete block processing, the system computes and applies LIC parameters for subblocks in advance as they become ready, ensuring that LIC is applied with the most current and accurate parameter values possible at each stage of the pipeline.
2Measurement precision
If LIC parameters are determined based on all neighboring samples for the block, then measurement precision improves, but processing time increases, worsening productivity
Solution Approach 1:
The patent segments the block into multiple subblocks and computes LIC parameters for each subblock independently based on the neighboring samples available for that specific subblock. This segmentation allows parallel computation across multiple subblocks, reducing total processing time while maintaining high accuracy for each subblock's LIC parameters based on its local neighboring samples.
Solution Approach 2:
The patent applies partial action by computing LIC parameters for each subblock based on the neighboring samples available at that stage of pipelined processing, rather than waiting for all neighboring samples to be fully processed. This partial computation approach maintains sufficient accuracy for each subblock while enabling faster overall processing through parallel execution.
Data Source
AI summary
Different implementations are described, particularly implementations for video encoding and decoding based on a linear model responsive to neighboring samples are presented. Accordingly, for a block being encoded or decoded in a picture, refined linear model parameters are determined for a current subblock in the block and for encoding the block, the local illumination compensation uses a linear model for the current subblock based on the refined linear model parameters. In a first embodiment, the number N of reconstructed samples increases with the available data for the subblock. In a second embodiment, partial linear model parameters are determined for the subblock and refined linear model parameters are derived from a weighted sums of partial linear model parameters. In a third embodiment, the subblocks are independently LIC processed.