Video Decoder Motion Compensation Across Blocks and Sub-Blocks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently processing motion compensation without compromising coding efficiency, particularly when performing these processes in units smaller than prediction blocks.
Innovation Solution
Implementing an encoder and decoder that derive motion vectors in units of prediction blocks using inter frame prediction modes, with some modes referring to spatial gradients of luminance for finer correction, and others not, to balance processing load and coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion compensation is performed in units smaller than prediction blocks (sub-blocks), then motion precision is improved, but processing complexity increases
Solution Approach 1:
The prediction block is divided into multiple sub-blocks, and motion compensation is performed independently for each sub-block. This segmentation allows finer motion precision at sub-block level while managing complexity through structured organization of the processing steps.
Solution Approach 2:
The patent implements dynamic selection between different operating modes (first mode using spatial gradients, second mode without spatial gradients) based on block characteristics. This allows the system to adapt processing complexity to actual needs, using finer sub-block processing only when necessary for maintaining motion precision.
2Productivity
If spatial gradient of luminance is used in motion compensation, then coding efficiency is improved, but processing load increases
Solution Approach 1:
The patent dynamically selects between two operating modes: first mode that uses spatial gradient of luminance for higher coding efficiency, and second mode that skips spatial gradient calculation to reduce processing load. The selection is based on block characteristics, allowing adaptive balance between coding efficiency and processing load.
Solution Approach 2:
Different processing approaches are applied to different regions or blocks based on their characteristics. Blocks that benefit from spatial gradient information use the first mode, while others use the second mode, optimizing the balance between coding efficiency and processing load locally rather than uniformly across all blocks.
Data Source
AI summary
A decoder includes circuitry and memory. Using the memory, the circuity, in a first operating mode, derives first motion vectors for a first block obtained by splitting a picture, using a first inter prediction scheme, and generates a prediction image corresponding to the first block, by referring to spatial gradients of luminance generated based on the first motion vectors. Using the memory, the circuitry, in a second operating mode, derives second motion vectors for a sub-block obtained by splitting a second block, using a second inter prediction scheme different from the first inter prediction scheme, the second block being obtained by splitting the picture, and generates a prediction image corresponding to the sub-block without referring to spatial gradients of luminance.