Motion Vector Selection Using Remote Motion Vectors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Motion estimation systems, particularly those using double-ended vectors, face challenges in accurately determining motion vectors when objects occlude or reveal background areas, leading to incorrect vector selection and artifacts such as holes or overlaps in interpolated frames.
Innovation Solution
The method computes candidate bi-directional motion vectors for a region, selects one vector, and uses remote motion vectors from offset locations to bias the selection, ensuring accurate vector choice by analyzing properties like magnitude, direction, and pixel match values to distinguish between correct and incorrect vectors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If double-ended motion estimation is used to produce interpolated frames, then exactly one value is produced for each pixel position, but incorrect vector selection occurs when objects occlude or reveal background areas
Solution Approach 1:
The patent uses remote motion vectors from offset locations to provide feedback that biases the selection of candidate motion vectors. The system computes multiple candidate vectors, then uses remote vector information to determine which candidate is most likely correct, creating a feedback loop that improves selection accuracy in occlusion scenarios.
Solution Approach 2:
The patent introduces remote motion vectors as an intermediary element. These remote vectors, obtained from blocks at offset locations, serve as a mediator to influence the selection of the correct motion vector for the current block, especially when occlusion makes direct comparison difficult.
2Measurement precision
If multiple candidate motion vectors are computed, then the system can distinguish between correct and incorrect vectors, but the selection process becomes more complex
Solution Approach 1:
The patent applies different selection criteria to different candidate vectors based on local characteristics. Remote motion vectors from specific offset locations are used to bias the selection, allowing the system to treat each candidate vector differently based on its consistency with remote vector information rather than using a uniform selection process.
3Ease of manufacture
If motion estimation is performed for each block independently, then processing is simpler, but holes and overlaps occur in interpolated frames
Solution Approach 1:
The patent merges information from multiple blocks by using remote motion vectors. The motion vector selection for each block is influenced by remote vectors from other blocks, effectively combining local and global motion information to prevent holes and overlaps while maintaining a block-based processing approach.
Data Source
AI summary
A motion estimation technique finds first and second candidate bi-directional motion vectors for a first region of an interpolated frame of video content by performing double ended vector motion estimation on the first region. One of these candidate bi-directional motion vectors is selected, and used to identify a remote region of the interpolated frame. This remote region is located at an off-set location from the first region, and is found based on an endpoint of the selected candidate bi-directional motion vector. A remote motion vector for the remote region of the interpolated frame is obtained, and one or more properties of this remote motion vector are used to bias a selection between the first and second candidate vectors.