Interpolation Frame Generation for Motion Vector Edge Cases
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing frame rate conversion methods experience visual discomfort due to difficulties in detecting accurate motion vectors, especially when pixels selected for interpolation are outside the effective pixel range of real frames.
Innovation Solution
An interpolation-frame generation device and method that includes a phase information generator, an extracted pixel determination unit, an interpolation-phase selector, and an interpolation-pixel generator, which generate phase information, determine extracted pixels based on motion vectors, and select interpolation phases to ensure interpolation-pixels are generated within effective pixel ranges, reducing visual discomfort.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If one-sided interpolation is used to generate interpolation-pixels using only pixels within the effective pixel range, then the device complexity is reduced, but visual discomfort increases when motion vectors are erroneously detected at frame edges
Solution Approach 1:
The patent dynamically switches between one-sided interpolation and another interpolation method based on whether motion vector crossing pixels are within the effective pixel range. This dynamic adaptation allows the system to maintain low complexity for most cases while improving reliability when edge cases occur
Solution Approach 2:
The patent changes the interpolation method parameter based on the position of motion vector crossing pixels. When pixels are within the effective range, one-sided interpolation is used; when outside, alternative interpolation is used, thereby adapting to different spatial conditions
2Speed
If motion vectors are used to select pixels for generating interpolation-pixels, then the frame rate conversion smoothness is improved, but visual discomfort occurs when selected pixels are outside the effective pixel range
Solution Approach 1:
The patent uses feedback from the position detection of motion vector crossing pixels to determine the appropriate interpolation method. This feedback mechanism ensures that when pixels fall outside the effective range, the system automatically switches to a more reliable interpolation approach
Solution Approach 2:
The system dynamically selects the interpolation method based on real-time detection of pixel positions. This dynamic selection maintains smooth frame rate conversion for normal cases while ensuring accuracy for edge cases where motion vectors point outside the effective range
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A phase information generator (3) generates phase information (i) indicating a phase of an interpolation-frame. An extracted pixel determination unit (4) generates first and second motion vector crossing pixels (P0, P1) at which the motion vector (MV) detected for generating an interpolation-pixel (Pi) intersects with the first and second frames, and determines extracted pixels (P0I, P1I) based on the motion vector crossing pixels (P0, P1). An interpolation-phase selector (5) selects an interpolation phase based on the phase information (i) and whether or not the first and second motion vector crossing pixels (P0, P1) are out of an effective pixel range. An interpolation-pixel generator (60) generates the interpolation-pixel (Pi) based on the first and second extracted pixels (P0I, P1I) and the interpolation phase.