Motion Compensated Interpolation With Reliability-Based Weighted Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Motion compensated interpolation methods in frame rate up-conversion suffer from blocky transitions and halo artifacts due to block-based motion estimation and occlusion phenomena, leading to inaccurate motion vector estimation, especially around moving object boundaries.
Innovation Solution
A weighted compensation method is applied to neighboring blocks, and a reliability check is performed on motion vectors to select between bi-directional, uni-directional, and null vector compensation, reducing occlusion artifacts and improving interpolation accuracy by using reliability metrics and weight kernels to ensure smooth transitions and accurate interpolation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If block-based motion estimation is used, then motion compensation can be implemented efficiently, but blocky transitions and halo artifacts occur at motion boundaries
Solution Approach 1:
The patent applies different interpolation strategies to different regions based on motion vector reliability. Reliable motion vectors use standard bidirectional interpolation, while unreliable vectors (detected through reliability metrics) trigger alternative methods like unidirectional interpolation or gradient-based approaches. This local differentiation resolves the contradiction by maintaining efficiency through block-based processing while improving accuracy locally where needed.
Solution Approach 2:
The patent introduces motion vector reliability as an additional parameter to control the interpolation process. By computing reliability metrics and using them to select interpolation methods, the system dynamically adjusts processing parameters based on local conditions. This resolves the contradiction by allowing efficient block-based processing to continue while introducing parameter-based control to eliminate artifacts in problematic regions.
2Stability of the object's composition
If bidirectional interpolation is used, then temporal smoothness is improved, but halo artifacts occur due to averaging foreground and background at motion boundaries
Solution Approach 1:
The patent implements a feedback mechanism where motion vector reliability is computed and used to control the interpolation process. The reliability metric provides feedback about the quality of motion estimation, and this feedback drives the selection of appropriate interpolation methods. This resolves the contradiction by using feedback to avoid bidirectional interpolation in regions where it would create halo artifacts while maintaining it in regions where it provides temporal smoothness.
Solution Approach 2:
The patent applies different interpolation methods to different spatial regions based on local motion vector reliability. In regions with high reliability, bidirectional interpolation maintains temporal smoothness. In regions with low reliability (typically at motion boundaries), alternative methods prevent halo artifacts. This local differentiation resolves the contradiction by allowing both benefits to coexist in different regions.
3Device complexity
If motion vector estimation is performed without reliability checking, then processing complexity is reduced, but occlusion artifacts and inaccurate interpolation occur
Solution Approach 1:
The patent performs reliability checking selectively rather than uniformly across all blocks. The reliability metrics are computed and used to identify only those regions where motion vector errors are likely to occur. This partial action approach resolves the contradiction by introducing reliability verification only where needed, rather than increasing complexity uniformly throughout the entire processing system.
Data Source
Figure 1~3
Figure 4
AI summary
A motion compensated interpolation method comprising the steps of obtaining a motion vector field by applying a motion estimation algorithm; checking the motion vector reliability; selecting an interpolation method among bi-directional, uni-directional and null vector interpolation methods, in accordance with the vector reliability check; and making a weighted compensation on neighboring blocks by applying the selected interpolation method is disclosed.