Motion Compensated Frame Rate Conversion with Artifact Protection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current frame rate conversion techniques, especially motion compensated schemes, suffer from high complexity and visual artifacts like 'halo' artifacts due to inaccuracies in motion compensation, limiting their availability and quality in consumer-grade video display systems.
Innovation Solution
A frame rate converter system that includes a motion vector interpolator, back and forward motion compensators, a combiner, and a protector to calculate and combine motion-compensated pixel values, with a median filter-like protector to select central values and protect against artifacts by using spatially close pixel values when motion vectors are inaccurate.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If motion compensated frame rate conversion is used, then image quality is improved, but device complexity increases
Solution Approach 1:
The motion compensation process is divided into separate stages: motion vector generation, motion vector interpolation to estimate intermediate frame vectors, and motion compensation using interpolated vectors. This segmentation allows complex motion compensation to be broken into manageable steps that can be implemented in consumer equipment.
Solution Approach 2:
Motion vectors for intermediate frames are pre-calculated through interpolation before the actual motion compensation step. By preparing interpolated motion vectors in advance from parent frame vectors, the system reduces real-time computational complexity while maintaining quality.
2Manufacturing precision
If motion compensated frame rate conversion is used, then image quality is improved, but visual artifacts increase
Solution Approach 1:
The system incorporates a protector that monitors motion compensation results and compares them against original frame data. When artifacts like halos are detected, the protector uses feedback from the comparison to switch to alternative compensation methods or adjust parameters, thereby reducing visual artifacts.
Solution Approach 2:
The system dynamically adjusts motion compensation parameters such as search window size, block size, and interpolation factors based on scene complexity and motion characteristics. By changing these parameters adaptively, the system maintains high image quality while minimizing artifact generation in different video content scenarios.
Data Source
AI summary
A system to interpolate between a number of images for the purpose of frame rate conversion may include a motion vector interpolator, a motion compensation module, and a protector. The motion vector interpolator may segment a motion vector into portions based on temporal distances of a target image from each of the number of images. The motion compensation module may generate at least two motion compensated values for a pixel in the target image based on the portions of the motion vector. The protector may choose a motion compensated value for the pixel in the target image when the motion vector is accurate and may choose a pixel value from one of the number of images when the motion vector is not accurate.