Adaptive Frame Rate Conversion Using Short-Sided Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional frame rate conversion methods for improving film-based content display on LCDs and other devices often compromise video quality due to inefficiencies in interpolating frames.
Innovation Solution
A method and system for frame rate upconversion by interpolating frames using a 'short-sided' approach, where motion compensated frames are generated based on the temporal position of the interpolated output frame, and blending or taking a weighted average of motion compensated frames from adjacent input frames to produce high-quality interpolated frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional frame rate conversion methods are used to convert footage from one frame rate to another, then frame rate conversion is achieved, but video quality deteriorates due to artifacts and interpolation inefficiencies
Solution Approach 1:
The patent applies dynamics by making the frame selection adaptive rather than static. The system dynamically determines whether to use the previous frame, next frame, or blend both frames based on motion characteristics. This dynamic adaptation allows the system to optimize video quality for each interpolated frame based on actual motion conditions, reducing artifacts while maintaining high frame rates.
Solution Approach 2:
The patent changes the parameter of frame selection by introducing a motion-based decision mechanism. Instead of always using a fixed interpolation method, the system varies the selection between previous frame, next frame, or blended frames based on motion magnitude and direction. This parameter change enables adaptive optimization of video quality across different motion scenarios.
2Manufacturing precision
If bidirectional frame blending is used for all interpolated frames, then video quality improves, but computational complexity and power consumption increase
Solution Approach 1:
The patent applies partial action by using bidirectional frame blending only when necessary - specifically when motion characteristics indicate it will improve quality. For low-motion or specific temporal positions, the system uses simpler unidirectional frame selection. This selective application of the more complex blending operation reduces overall computational load and power consumption while maintaining video quality where it matters most.
Solution Approach 2:
The patent segments the frame interpolation process into different strategies based on temporal position and motion characteristics. Instead of applying a uniform blending approach to all frames, the system divides the interpolation task into regions where different methods (previous frame only, next frame only, or blended) are applied. This segmentation reduces unnecessary computations and power consumption.
3Manufacturing precision
If motion compensated frames are generated for all interpolated frames, then video quality improves, but processing time and computational load increase
Solution Approach 1:
The patent applies partial action by generating motion compensated frames only for specific interpolated frames where motion characteristics indicate it will benefit quality. For other frames, simpler interpolation methods are used. This selective approach maintains video quality where needed while reducing overall processing time and computational load.
Solution Approach 2:
The patent applies local quality by using different frame generation strategies for different temporal positions and motion regions. Instead of uniformly applying motion compensation to all frames, the system applies it locally where motion characteristics warrant it. This local optimization maintains quality in critical areas while improving overall processing efficiency.
Data Source
AI summary
At least a method and a system are described for providing frame rate upconversion by way of using “short side” or bidirectional interpolation in generating interpolated frames. In a representative embodiment, the method may comprise receiving a first frame of video corresponding to a first frame time and a second frame of the video corresponding to a second frame time, computing a first absolute difference between the first frame time and an interpolated frame time wherein the interpolated frame time temporally is located between the first frame time and the second frame time. The method further comprises using a first motion vector field and the first frame to compute a third frame at the interpolated frame time. The method further comprises outputting the third frame as the interpolated frame at the interpolated frame time if the first absolute difference is less than or equal to a first threshold value.