Video Frame Rate Conversion With Adaptive Artifact-Aware Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing frame rate conversion (FRC) methods suffer from high computational complexity and inaccuracies in detecting artifacts, leading to non-smooth playback or significant image artifacts, especially on devices with limited resources.
Innovation Solution
A video frame rate conversion method that partitions frames into blocks, estimates motion on a block-by-block basis, calculates an artifact probability metric, and adaptively decides between motion-compensated interpolation and linear combination of frames to reduce computational complexity and improve accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If motion-compensated frame interpolation is used, then playback smoothness is improved, but computational complexity increases and artifacts may appear
Solution Approach 1:
The video frame is divided into multiple blocks, and motion compensation is applied block-by-block. This segmentation allows the system to process only necessary regions with complex algorithms while using simpler methods for other areas, reducing overall computational complexity while maintaining playback smoothness.
Solution Approach 2:
The patent applies different processing strategies to different regions based on local characteristics. In regions with high motion or occlusion, linear combination is used to avoid artifacts, while in stable regions, motion-compensated interpolation maintains smoothness. This local adaptation resolves the contradiction by matching algorithm complexity to actual need.
2Stability of the object's composition
If motion-compensated frame interpolation is used, then playback smoothness is improved, but image artifacts increase
Solution Approach 1:
The patent calculates an artifact probability metric based on motion vector analysis and occlusion detection, then uses this feedback to dynamically adjust the interpolation strategy. When artifact probability exceeds thresholds, the system switches to linear combination, preventing artifacts while maintaining smoothness in acceptable regions.
Solution Approach 2:
The patent dynamically adjusts the interpolation method based on real-time analysis of motion characteristics and occlusion patterns. Rather than using a fixed approach, the system adapts its strategy block-by-block, switching between motion-compensated interpolation and linear combination to balance smoothness and artifact prevention.
3Device complexity
If linear combination of frames is used, then computational complexity is reduced, but playback smoothness deteriorates
Solution Approach 1:
The patent applies linear combination only in specific regions where motion is minimal or occlusion is detected, rather than globally. This localized application reduces computational complexity while preserving playback smoothness in regions where motion compensation would be beneficial.
Solution Approach 2:
The patent uses motion-compensated interpolation partially, only in regions where it provides value. By combining partial motion compensation with linear combination in other regions, the system achieves acceptable smoothness with reduced computational complexity.
4Measurement precision
If artifact detection accuracy is improved, then artifact replacement decisions are better, but computational complexity increases
Solution Approach 1:
The patent analyzes motion vectors and occlusions block-by-block rather than for the entire frame. This segmentation allows accurate artifact detection in each local region while reducing overall computational complexity through parallel processing and focused analysis.
Solution Approach 2:
The patent extracts only the critical features needed for artifact detection (motion vector discontinuities, occlusion patterns) rather than performing full frame analysis. This extraction of essential information maintains detection accuracy while significantly reducing computational requirements.
Data Source
AI summary
A video frame rate conversion (FRC) method, including obtaining at least one pair of frames of a video; partitioning each frame into a plurality of blocks; estimating motion a block-by-block basis to obtain: a forward motion field including a set of first motion vectors, and a backward motion field including a set of second motion vectors; obtaining occlusions based on the forward motion field and the backward motion field; and calculating an artifact probability metric indicating a probability of an appearance of an artifact in the motion-compensated frame interpolation between the first frame and the second frame.