Region-Based Video Interpolation for Frame Rate Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video-image-interpolation apparatuses produce errors such as jitter when converting video frame rates, especially when dealing with different frame rates like 25 Hz and 30 Hz, due to performing motion estimation and compensation on entire frames rather than region-based approaches.
Innovation Solution
A region-based video-image-interpolation apparatus that divides input video signals into regions, performs motion-compensated frame interpolation and frame-rate conversion on these regions separately, and synthesizes the output images to address frame rate discrepancies, using techniques like edge detection and image-layering to determine motion vectors and interpolate images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If motion estimation and compensation are performed on the entire frame, then the video frame-rate conversion can be achieved, but picture jitter occurs when dealing with different frame rates
Solution Approach 1:
The patent divides the video signal into multiple regions (first regions and second regions) with different frame rates. Motion estimation and compensation are performed separately for each region based on its specific frame rate, rather than applying a uniform approach to the entire frame. This segmentation resolves the contradiction by enabling accurate frame-rate conversion for each region while maintaining overall picture stability.
2Reliability
If region-based motion compensation is performed separately for different regions, then picture jitter is reduced, but device complexity increases
Solution Approach 1:
The video signal is segmented into multiple regions, each processed independently with appropriate motion compensation parameters. This allows the system to handle different frame rates in different regions while maintaining picture stability, resolving the contradiction between reliability and complexity through structured division of processing tasks.
Solution Approach 2:
Different motion compensation parameters and processing methods are applied to different regions based on their specific requirements (first regions with one frame rate, second regions with another frame rate). This local quality approach optimizes picture stability for each region while managing overall system complexity through targeted processing.
3Speed
If conventional MEMC is used for frame rate conversion, then processing speed is maintained, but accuracy of frame-rate conversion deteriorates due to errors
Solution Approach 1:
By segmenting the video signal into regions with different frame rates and applying region-specific motion compensation, the patent achieves accurate frame-rate conversion for each region while maintaining efficient processing speed through parallel processing of multiple regions.
Solution Approach 2:
The patent changes the motion compensation parameters (motion vectors, search ranges, reference frame selections) based on the specific frame rate of each region. This parameter adaptation improves conversion accuracy for different frame rates while maintaining processing efficiency through optimized parameter selection for each region type.
Data Source
AI summary
A method of region-based video-image interpolation is provided, which includes the following steps: respectively dividing each image and its subsequent image in an input video signal into first regions and second regions to obtain first regional images and second regional images; performing a motion-compensated frame-interpolation process on the first regional image and the second regional image in the same position in each image and its subsequent image to obtain an interpolated regional image; performing a frame-rate-conversion process on reference images and the interpolated regional images of each first region according to an original frame rate of each first region and a display frame rate of an output video signal to obtain a regional output image of each first region; and superimposing the regional output image generated at each output timestamp by each motion-compensated frame-interpolation circuit to generate an output image of the output video signal.