Motion Compensated Video Interpolation Artefact Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Motion compensated video interpolation systems often produce artefacts due to poor motion estimation, especially in cases of complex or erratic motion, occlusion, aliasing, and scaling, which affect the quality of interpolated frames.
Innovation Solution
Introducing a working scale factor to modify the temporal position of interpolated frames relative to their ideal display time, shifting the interpolation time instance closer to an input frame to reduce the impact of erratic motion vectors and minimize artefacts, while maintaining smoothness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If motion estimation is performed using block matching techniques to create interpolated frames, then frame rate conversion and motion compensation are achieved, but artefacts become visible due to poor motion estimation in regions with complex or erratic motion
Solution Approach 1:
The patent changes the temporal parameter by introducing a working scale factor that modifies the temporal position at which interpolated frames are created. Instead of creating interpolated frames at their ideal temporal positions, the system creates them at shifted temporal positions closer to the previous input frame, reducing the visibility of artefacts while maintaining smoothness through subsequent display timing adjustments.
2Stability of the object's composition
If the interpolated frame is created at its ideal temporal position, then smooth motion is maintained, but artefacts from poor motion estimation remain highly visible
Solution Approach 1:
The patent applies preliminary anti-action by preemptively reducing artefact visibility through temporal position shifting before the interpolated frame is displayed. By creating the interpolated frame at a shifted temporal position closer to the previous input frame, the system reduces the impact of erratic motion vectors and minimizes artefact visibility in advance, while still maintaining smoothness through the display timing mechanism.
3Loss of information
If motion vectors are constrained to achieve lowest error block matches, then compression efficiency is improved, but the motion vectors may no longer represent true scene motion
Solution Approach 1:
The patent changes the temporal parameter of frame creation to compensate for inaccurate motion vectors. By shifting the temporal position of interpolated frame creation closer to the previous input frame, the system reduces the impact of motion vector inaccuracies while still utilizing the compressed representation benefits, thus maintaining both compression efficiency and visual quality.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
A method and apparatus are provided for motion compensated video interpolation. Each field or frame in a sequence of video images is subdivided into a plurality of blocks and a motion vector field is derived using block matching for a current video field using data matched to a previous video field or frame. A first time instance is determined at which an interpolated block is to be displayed and a second time instance is determined at which a corresponding interpolated block is to be created. Video data for each block is interpolated at its second time instance for each block and is then output for display at the first time instance.