Video Encoder-Decoder Motion Compensation With Luminance Gradients
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently processing motion compensation due to high computational complexity and potential decreases in coding efficiency when operating at sub-block levels.
Innovation Solution
Implementing an encoder and decoder that derive motion vectors in units of prediction blocks, utilizing spatial gradients of luminance for finer correction, and optionally performing motion compensation in sub-blocks without referencing spatial gradients to balance processing and efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If motion compensation is performed in sub-block units, then coding precision is improved, but processing complexity increases
Solution Approach 1:
The patent divides the prediction block into multiple sub-blocks and performs motion compensation independently for each sub-block. This segmentation allows finer-grained motion representation, improving coding precision while managing complexity through localized processing rather than global optimization.
Solution Approach 2:
The patent applies different processing approaches to different regions by using sub-block level motion compensation where needed. Each sub-block can have its own motion vector and compensation parameters, allowing local optimization of coding precision without uniformly increasing complexity across the entire block.
2Device complexity
If motion compensation is performed in prediction block units, then processing complexity is reduced, but coding precision deteriorates
Solution Approach 1:
The patent segments the prediction block into sub-blocks to perform motion compensation at a finer granularity. This segmentation improves coding precision by capturing local motion variations that would be missed in coarse block-level compensation, while still maintaining manageable complexity through systematic processing of smaller units.
Solution Approach 2:
The patent applies motion compensation at sub-block level, which is a finer granularity than traditionally necessary. This partial excessive action improves coding precision by over-segmenting the blocks, allowing more detailed motion representation even though it increases processing requirements compared to standard block-level compensation.
3Productivity
If spatial gradient of luminance is referenced for motion compensation, then coding efficiency is improved, but processing complexity increases
Solution Approach 1:
The patent performs preliminary calculation of spatial gradients of luminance before the motion compensation process. By pre-computing these gradient values, the patent reduces the complexity during the actual motion compensation phase, as the gradient data is already available for reference without requiring real-time computation during encoding/decoding.
Solution Approach 2:
The patent uses spatial gradients of luminance as an intermediary parameter to improve motion compensation accuracy. These gradients serve as additional reference information that helps determine motion vectors and compensation parameters, improving coding efficiency by providing more accurate motion representation without directly increasing the complexity of the core compensation algorithm.
Data Source
AI summary
A decoder includes circuitry and memory. Using the memory, the circuitry, in a first operating mode, derives first motion vectors for a first block obtained by splitting a picture, using a first inter prediction scheme, and generates a prediction image corresponding to the first block, by referring to spatial gradients of luminance generated based on the first motion vectors. Using the memory, the circuitry, in a second operating mode, derives second motion vectors for a sub-block obtained by splitting a second block, using a second inter prediction scheme different from the first inter prediction scheme, the second block being obtained by splitting the picture, and generates a prediction image corresponding to the sub-block without referring to spatial gradients of luminance.