Motion Estimation Encoding Using Parallel Macroblock Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional motion estimation systems for video encoding, such as h.264, require extensive computations and result in long encoding times due to their sequential processing approach, which is inefficient compared to earlier MPEG encoders.
Innovation Solution
A multi-processing unit calculates motion estimation for multiple macroblocks in parallel, using pre-calculated motion estimation information to estimate motion vectors and reduce encoding time by leveraging a frame buffer to delay and reuse previous frames for faster processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If h.264 uses improved motion estimation method (quarter pel based motion estimation, motion estimation using variable block, motion estimation using multiple frame referencing, estimation using weights and Lagrange cost based motion estimation), then compression rate is improved, but quantity of computations increases significantly
Solution Approach 1:
The patent divides the motion estimation process into multiple independent stages: initial motion vector estimation, refinement stages with different precision levels (half-pel, quarter-pel), and cost calculation. Each stage processes macroblocks independently and can be executed in parallel, reducing the computational burden at any single point while maintaining the overall improved compression rate.
Solution Approach 2:
The patent performs preliminary motion vector estimation using integer-pel precision before refining to half-pel and quarter-pel precision. This preliminary action eliminates many macroblocks that don't require high-precision estimation, reducing the total computational load while still achieving good compression rates for the remaining important macroblocks.
2Ease of operation
If conventional hardware based motion estimation system processes macroblock by macroblock in raster scan direction, then encoding is simplified, but encoding time becomes relatively long
Solution Approach 1:
The patent segments the encoding process into independent parallel tasks: motion estimation for multiple macroblocks, cost calculation, and motion vector selection. These segmented tasks can be executed simultaneously using multiple processing units, dramatically increasing encoding speed while keeping each individual task relatively simple.
Solution Approach 2:
The patent transitions from sequential one-dimensional processing (raster scan direction) to parallel multi-dimensional processing by utilizing multiple processing units that can handle multiple macroblocks simultaneously. This dimensional change from time-sequential to space-parallel processing resolves the contradiction between simplicity and speed.
3Measurement precision
If motion estimation calculates cost considering data quantity for encoding motion vector difference and video error through Lagrange multiplier, then motion vector accuracy is improved, but computational complexity increases
Solution Approach 1:
The patent applies different levels of motion estimation precision to different macroblocks based on their local characteristics. Important macroblocks with significant motion or detail receive quarter-pel precision with full cost calculation, while less important macroblocks use half-pel or integer-pel precision with simplified cost calculation, optimizing the balance between accuracy and complexity locally.
Solution Approach 2:
The patent performs full Lagrange cost-based motion estimation only for a subset of macroblocks that benefit most from high precision, while using simplified estimation methods for other macroblocks. This partial application of the complex algorithm reduces overall computational complexity while maintaining motion vector accuracy where it matters most.
Data Source
AI summary
Provided are an encoding system using motion estimation and an encoding method using motion estimation for achieving high-speed motion estimation according to a multi-processing unit. The encoding system using motion estimation, comprises a multi-processing unit calculating motion estimation on many macroblocks of an input image, a motion estimator estimating motion vectors of the macroblocks of the input image using the motion estimation on the plurality of macroblocks, previously calculated by the multi-processing unit, and an encoder encoding the image based on the motion vectors of the macroblocks, estimated by the motion estimator. According to the present invention, motion estimation to be used for motion estimation can be calculated in advance according to the multi-processing unit capable of processing high-speed parallel processing to reduce an image encoding time and improve an encoding speed.