Frame Interpolation Using True Motion and Layer Information
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current frame interpolation methods face challenges in generating high-quality results due to inaccuracies in motion estimation and difficulties in object cover/uncover analysis, leading to artifacts, even when using true motion information.
Innovation Solution
The method employs true motion fields at the interpolation phase, using block-level and pixel-level layer information to interpolate frames, filling holes in information through processing, and employing a layer-based M*N filter to smooth motion, with optional manual editing for complex regions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If true motion information is used for frame interpolation, then image quality is improved, but artifacts still occur at the interpolation phase due to imperfect motion vector calculation
Solution Approach 1:
The image is divided into multiple blocks, and motion vectors are calculated independently for each block. This segmentation allows for more precise local motion compensation and reduces artifacts caused by uniform motion assumptions across entire frames.
Solution Approach 2:
Different interpolation methods are applied to different regions of the image based on local characteristics. Edge regions use one interpolation approach while interior regions use another, optimizing quality for each specific area and reducing overall artifacts.
2Device complexity
If current frame interpolation methods are used, then processing is simplified, but object cover/uncover analysis becomes difficult
Solution Approach 1:
Motion vectors and layer information are calculated in advance for the original frames before interpolation. This preliminary analysis of object positions and movements enables accurate cover/uncover detection during the interpolation process without significantly increasing overall complexity.
Solution Approach 2:
Layer information serves as an intermediary data structure that tracks object positions and relationships across frames. This intermediate representation simplifies the detection of cover/uncover events by providing explicit object hierarchy information that can be queried during interpolation.
Data Source
AI summary
A method to produce a frame of video data includes receiving original frame true motion information, original frame object boundary information, and original frame layer information for at least two original frames of video data, and generating interpolation phase block-level motion and interpolation phase pixel-level layer information from the original frame block-level true motion information, original frame pixel-level object boundary information, and original frame pixel-level layer information for the original frame.