Frame Rate Conversion Using Noise-Based Motion Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-definition video frame rate conversion techniques face challenges in minimizing noise-induced image quality degradation, particularly when inserting interpolation frames to increase frame rates, leading to motion blur and suboptimal image quality.
Innovation Solution
A processor-based method for frame rate conversion that determines noise strength in image frames, estimates motion vectors for interpolation frames based on noise strength, and adjusts frame rates by inserting interpolation frames between current and adjacent frames, using block matching and pixel value differences to correct motion vectors according to noise levels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If interpolation frames are inserted to increase frame rate, then frame rate is improved, but image quality deteriorates due to noise
Solution Approach 1:
The patent applies local quality by differentiating noise strength across different blocks within the same frame. Each block is evaluated individually for noise strength, and motion estimation is performed selectively based on local noise characteristics rather than applying a uniform approach to the entire frame. This allows high-quality motion estimation in low-noise blocks while using simplified methods in high-noise blocks.
Solution Approach 2:
The patent changes the parameter of motion estimation complexity based on noise strength. When noise strength exceeds a threshold, the system switches from full block matching to simplified motion vector copying from neighboring blocks. This dynamic parameter adjustment optimizes the balance between processing accuracy and noise robustness.
2Measurement precision
If block matching is performed for motion estimation, then motion accuracy is improved, but processing complexity increases due to noise sensitivity
Solution Approach 1:
The patent performs preliminary noise strength evaluation for each block before conducting block matching. This preliminary action identifies blocks that are unsuitable for accurate motion estimation due to high noise, allowing the system to skip complex block matching operations in those regions and directly use simplified motion vector derivation methods.
Solution Approach 2:
The patent applies partial action by performing full block matching only on blocks with low noise strength, while using simplified motion vector copying for blocks with high noise strength. This selective application of processing intensity optimizes the overall system performance by avoiding excessive processing in noisy regions where it would not yield accurate results.
Data Source
AI summary
A frame rate conversion apparatus is provided. The frame rate conversion apparatus includes at least one processor configured to determine a noise strength of a block of a current frame among a plurality of frames forming an input video, generate a block of an interpolation frame corresponding to the block of the current frame by estimating a motion vector of a block of the interpolation frame based on the noise strength, and insert the interpolation frame between the current frame and an adjacent frame to adjust a frame rate of the input video.