Video Encoder Motion Compensation Using Luminance Gradients
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding and decoding technologies face challenges in efficiently processing motion vectors and motion compensation due to the complexity of sub-block processing, leading to decreased coding efficiency.
Innovation Solution
The encoder and decoder utilize a first inter frame prediction mode to derive motion vectors and perform motion compensation in units of prediction blocks, referencing spatial gradients of luminance, thereby reducing processing complexity while maintaining coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion vector derivation and motion compensation are performed in units of sub-blocks, then motion compensation precision is improved, but processing complexity increases
Solution Approach 1:
The patent segments the prediction block into sub-blocks for motion vector derivation, allowing different motion vectors to be calculated for different sub-regions. This segmentation enables precise motion compensation for each sub-block while maintaining the overall prediction block structure, thus achieving high precision without excessive processing complexity.
Solution Approach 2:
The patent applies local quality by deriving motion vectors specifically for sub-blocks rather than uniformly for the entire prediction block. This allows motion compensation to be optimized for local regions with different motion characteristics, improving precision where needed while avoiding unnecessary processing in uniform regions.
2Device complexity
If motion vector derivation and motion compensation are performed in units of prediction blocks, then processing complexity is reduced, but motion compensation precision deteriorates
Solution Approach 1:
The patent segments the prediction block into sub-blocks for motion vector derivation, allowing different motion vectors to be calculated for different sub-regions. This segmentation enables precise motion compensation for each sub-block while maintaining the overall prediction block structure, thus achieving high precision without excessive processing complexity.
Solution Approach 2:
The patent applies local quality by deriving motion vectors specifically for sub-blocks rather than uniformly for the entire prediction block. This allows motion compensation to be optimized for local regions with different motion characteristics, improving precision where needed while avoiding unnecessary processing in uniform regions.
3Productivity
If sub-block processing is applied, then coding efficiency is improved, but processing time increases
Solution Approach 1:
The patent segments the prediction block into sub-blocks for motion vector derivation, allowing different motion vectors to be calculated for different sub-regions. This segmentation enables precise motion compensation for each sub-block while maintaining the overall prediction block structure, thus achieving high precision without excessive processing complexity.
Solution Approach 2:
The patent applies partial action by performing motion vector derivation only for sub-blocks that require it, rather than uniformly for all prediction blocks. This selective approach improves coding efficiency for regions with complex motion while avoiding unnecessary processing time in regions with simple motion characteristics.
Data Source
AI summary
An encoder includes memory and circuitry. The circuitry: derives a first motion vector in a unit of a prediction block using a first inter frame prediction mode that uses a degree of matching between two reconstructed images of two regions in two difference pictures, the prediction block being obtained by splitting an image included in a video; and performs, in the unit of the prediction block, a first motion compensation process that generates a prediction image by referring to a spatial gradient of luminance in an image generated by performing motion compensation using the first motion vector derived.


