Affine Motion Estimation Pre-Analysis for Video Encoding Complexity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding technologies face inefficiencies in affine motion estimation, particularly in pre-analysis stages, which can increase computational complexity and reduce coding efficiency due to the need for extensive search iterations and high-resolution motion vector calculations.
Innovation Solution
The implementation of affine motion estimation in a pre-analysis stage using down-scaled images and simplified configurations, such as fixed block sizes and reduced iteration numbers, allows for the determination of affine parameters with a flag indicating cost efficiency, enabling skipping of translational motion estimation and direct application of affine estimation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If affine motion estimation is performed using full-resolution images and extensive search iterations, then prediction accuracy is improved, but computational complexity increases
Solution Approach 1:
The patent divides the motion estimation process into two separate stages: a pre-analysis stage using down-scaled images for initial parameter estimation, and a refinement stage using full-resolution images for final parameter optimization. This segmentation allows the computationally intensive full-resolution processing to be limited to only those blocks that require it, reducing overall computational complexity while maintaining prediction accuracy where needed
Solution Approach 2:
The patent performs preliminary motion estimation on down-scaled images before processing full-resolution images. This preliminary action provides initial affine parameters that guide the subsequent full-resolution estimation, reducing the search space and iteration requirements in the refinement stage, thereby lowering computational complexity while preserving accuracy
2Productivity
If affine motion estimation is performed on all blocks with extensive iterations, then coding efficiency is improved, but processing time increases
Solution Approach 1:
The patent applies different processing qualities to different blocks based on their characteristics. Blocks with simple motion patterns use the faster down-scaled estimation, while blocks with complex motion require the more accurate but slower full-resolution refinement. This local differentiation optimizes the balance between coding efficiency and processing time by applying computational resources only where necessary
Solution Approach 2:
The patent performs partial action by applying full-resolution affine motion estimation only to selected blocks that benefit most from it, rather than processing all blocks at full resolution. This selective approach maintains coding efficiency for complex blocks while reducing overall processing time by avoiding unnecessary full-resolution processing on simpler blocks
Data Source
AI summary
An affine motion estimation (ME) is performed on a current block to determine affine parameters of the current block in a pre-analysis stage. The affine ME is performed based on at least one of (i) a down-scaled current picture and one or more down-scaled reference pictures of the down-scaled current picture, (ii) a simplified configuration, or (iii) a fixed block size of the current block being equal to or larger than a threshold. The affine parameters of the current block determined in the pre-analysis stage are stored. Affine parameters of the current block are determined based on the affine parameters stored in the pre-analysis stage. The current block is reconstructed based on the determined affine parameters of the current block.