Occlusion Region Interpolation in Video Frame Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interpolation frame generating methods struggle to effectively interpolate pixel values in occlusion regions, particularly in motion regions, leading to distorted motion vectors and erroneous assignments.
Innovation Solution
The proposed solution involves a motion estimation unit that estimates motion vectors between reference frames, a detection unit that identifies occlusion regions, and a filtering unit that assigns weighted motion vectors to these regions, ensuring accurate pixel value interpolation by calculating degrees of difference and using weighted means to determine appropriate pixel values.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional interpolation methods are used for occlusion regions, then processing simplicity is maintained, but interpolation accuracy deteriorates due to distorted motion vectors and erroneous pixel value assignments
Solution Approach 1:
The image is divided into multiple blocks, and motion vectors are estimated for each block separately. This segmentation allows the system to handle different regions (occlusion and non-occlusion) with appropriate methods, improving interpolation accuracy by treating each region according to its characteristics while maintaining manageable processing complexity through systematic block-based processing.
Solution Approach 2:
Different processing methods are applied to different regions: occlusion regions use one interpolation approach while non-occlusion regions use another. The system identifies occlusion regions through motion vector analysis and applies localized processing strategies, ensuring high interpolation accuracy for each region type without requiring complex global processing.
2Loss of information
If motion vectors are estimated for all blocks, then motion information completeness is improved, but processing time increases due to the need to handle both occlusion and non-occlusion regions
Solution Approach 1:
The system performs motion vector estimation for all blocks (excessive action) to ensure complete motion information, but then selectively applies different processing to only the necessary regions. By identifying occlusion regions and applying specialized handling only where needed, the system recovers processing time while maintaining complete motion information for accurate interpolation throughout the image.
Data Source
AI summary
According to one embodiment, an apparatus includes a motion estimation unit, a generating unit, a detection unit, and a filtering unit. The motion estimation unit is configured to estimate a first motion vector from a first reference frame to a second reference frame. The generating unit is configured to assign a first pixel value and a second motion vector to an interpolation frame. The detection unit is configured to detect an occlusion region in the interpolation frame. The filtering unit is configured to assign the second motion vector to the occlusion region as a third motion vector, calculate degrees of difference between second pixel values derived from the second motion vectors and third pixel values derived from the third motion vectors, and assign a fourth pixel value derived from a fourth motion vector to the occlusion region, wherein the fourth motion vector is calculated based on the degrees of difference.