Motion Estimation for Isolated Objects Using Block Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing motion estimation methods for small objects in video frame rate conversion require extensive hardware resources and increased costs due to the need for numerous comparisons.
Innovation Solution
An apparatus and method that divides images into blocks, flags isolated objects, analyzes continuity, calculates initial motion vectors, and determines vector correctness using a sum of absolute differences (SAD), reducing comparison counts and hardware requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full-search motion estimation is used for small objects, then motion vector accuracy is improved, but hardware resources and costs increase significantly
Solution Approach 1:
The patent segments the image into multiple blocks and identifies isolated objects within specific blocks. By focusing motion estimation only on blocks containing isolated objects rather than performing full-search on the entire image, the hardware resource requirements are significantly reduced while maintaining motion vector accuracy for small objects.
Solution Approach 2:
The patent applies different processing strategies to different regions of the image. Blocks containing isolated objects receive focused motion estimation processing, while other blocks use simpler background processing. This local differentiation reduces overall computational complexity while ensuring accurate motion vectors where needed.
2Measurement precision
If full-search motion estimation is used for small objects, then motion vector accuracy is improved, but calculation time increases
Solution Approach 1:
By segmenting the image into blocks and identifying only those blocks containing isolated objects, the patent reduces the total number of comparisons required. This selective approach maintains motion vector accuracy for small objects while significantly reducing calculation time compared to full-search methods.
Solution Approach 2:
The patent performs preliminary identification of isolated objects and their locations before conducting motion estimation. This preliminary action allows the system to focus computational resources only on relevant blocks, reducing overall calculation time while ensuring accurate motion vectors for small objects.
3Reliability
If more comparisons are performed for small object motion estimation, then motion vector convergence is improved, but hardware resources increase
Solution Approach 1:
The patent divides the image into blocks and performs motion estimation only on blocks containing isolated objects. This segmentation allows sufficient comparisons to be made within each relevant block to achieve reliable motion vector convergence, while avoiding unnecessary comparisons in other blocks, thus reducing hardware resource requirements.
Solution Approach 2:
The patent applies enhanced motion estimation with multiple comparisons locally only to blocks containing small isolated objects, while using simpler processing elsewhere. This local quality approach ensures reliable motion vector convergence where needed without proportionally increasing overall hardware resources.
Data Source
AI summary
An apparatus and a method for motion estimation of isolated objects are provided. The apparatus includes a dividing circuit, a flag circuit, an analyzing circuit, a calculating circuit and a determination circuit. The dividing circuit divides each of a first image and a second image into a plurality of blocks. The flag circuit adds a flag to each block within the blocks having image information different from background information. The analyzing circuit analyzes continuity of the flag to find a target isolated object having a size less than or equal to a predetermined size. The calculating circuit obtains an initial motion vector of the target isolated object according to locations of the target isolated object in the first image and the second image. The determination circuit determines whether the initial motion vector is correct according to a sum of absolute differences corresponding to the initial motion vector.