Image-Area Frame Interpolation for Smooth Mixed-Rate Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing frame interpolation methods fail to provide smooth motion without motion judder when dealing with images having different original frame rates in various areas, leading to inconsistent motion quality across the image.
Innovation Solution
An electronic device that identifies original frame rates for each image area, performs motion estimation and interpolation based on these rates, and generates interpolated frames to ensure smooth motion across the entire image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single frame rate is used for the entire image, then the processing complexity is reduced, but motion smoothness deteriorates in areas with different original frame rates
Solution Approach 1:
The image is divided into multiple image areas, each with its own identified original frame rate. This segmentation allows the system to apply frame interpolation tailored to each area's specific frame rate requirements, resolving motion judder without requiring a single complex processing approach for the entire image.
Solution Approach 2:
Different interpolation time points and frame rates are applied to different image areas based on their local original frame rates. This local quality approach ensures that each area receives the appropriate level of motion smoothing, improving overall motion smoothness while maintaining processing efficiency.
2Reliability
If frame interpolation is performed for all image areas, then motion smoothness is improved, but processing time increases
Solution Approach 1:
The system performs preliminary identification of original frame rates for each image area before conducting frame interpolation. This preliminary action allows the system to plan the interpolation process efficiently, reducing processing time by preparing interpolation parameters in advance rather than computing them during the interpolation phase.
Solution Approach 2:
The system performs frame interpolation selectively based on identified original frame rates, applying interpolation only where needed to achieve smooth motion. This partial action approach avoids unnecessary processing in areas that already have adequate frame rates, reducing overall processing time while maintaining motion smoothness where required.
3Reliability
If different interpolation time points are used for different image areas, then motion consistency is improved, but processing complexity increases
Solution Approach 1:
The system dynamically adjusts interpolation time points for each image area based on its original frame rate. This dynamic approach allows the system to handle varying frame rates across different areas, improving motion consistency while managing processing complexity through adaptive rather than static processing.
Data Source
AI summary
An electronic device includes a display, memory, and one or more processors. The electronic device, based on original frame rates of respective image areas of an input image being identified, identifies interpolation time points for the respective image areas and a plurality of key frames based on the original frame rates of the respective image areas, obtains interpolated frames corresponding to the interpolation time points for the respective image areas based on the plurality of key frames, and controls the display to display an output image based on the obtained interpolated frames.