Interpolated Frame Generation Using Temporal Matching Difference
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing methods face challenges in generating high-quality interpolated frames, particularly at low display frame rates, due to inconsistencies in motion vector reliability, leading to artifacts like motion judder and area flicker, which are not adequately addressed by solely relying on spatial relationship results.
Innovation Solution
A method and apparatus that calculate a temporal matching difference in addition to spatial relationship results to assess motion vector reliability, using a motion estimator, spatial relationship generator, and motion compensated interpolator to derive an interpolated frame, incorporating a look-up table to adjust spatial relationship results and determine vector reliability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If motion-compensated frame interpolation is used to increase display frame rate, then motion judder artifact is reduced, but area flicker and motion vector reliability inconsistencies remain
Solution Approach 1:
The patent implements a feedback mechanism where the spatial relationship generator continuously monitors the consistency of motion vectors with their neighboring blocks and provides feedback to the motion compensated interpolator. This feedback loop allows the system to adjust interpolation operations based on actual motion vector reliability, reducing area flicker while maintaining smooth motion transitions.
Solution Approach 2:
The patent applies local quality by differentiating the treatment of motion vectors based on their spatial relationship with neighboring blocks. Motion vectors with consistent spatial relationships receive higher weight in interpolation, while those with inconsistencies are down-weighted or corrected. This localized approach ensures that only reliable motion information drives the interpolation process.
2Object-affected harmful factors
If frame rate is increased to prevent area flicker, then display quality improves, but computational complexity and processing time increase
Solution Approach 1:
The patent performs preliminary action by pre-calculating and storing spatial relationship results in a lookup table during frame preparation. This lookup table is then referenced during the interpolation process, eliminating the need for real-time complex spatial relationship calculations and significantly reducing processing complexity while maintaining high frame rates.
Solution Approach 2:
The spatial relationship generator acts as an intermediary component that bridges the motion estimator and motion compensated interpolator. It processes motion vector information and generates spatial relationship results that guide the interpolation process, simplifying the overall computational workflow and enabling efficient high-frame-rate processing.
3Measurement precision
If motion estimation is performed at pixel level to generate motion vectors, then interpolation precision improves, but processing time and computational load increase
Solution Approach 1:
The patent applies partial action by performing motion estimation at block level rather than pixel level, which provides sufficient precision for most applications while significantly reducing computational load. The spatial relationship generator then compensates for this coarser estimation by analyzing the consistency of motion vectors with neighboring blocks, maintaining interpolation quality without the full computational burden of pixel-level analysis.
Data Source
AI summary
A method for generating an interpolated frame includes: calculating a temporal matching difference corresponding to a target motion vector of a current block by performing a motion estimation on the current block; deriving a spatial relationship result according to the target motion vector and motion vectors corresponding to a plurality of neighboring image blocks; and deriving the interpolated frame according to the target motion vector, the spatial relationship result, and the temporal matching difference.