Motion Compensator Border Validation for Video Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional motion compensation algorithms in frame rate conversion for video sequences suffer from picture quality degradation due to the inclusion of non-active image areas, particularly when objects cross the border of the active image area, leading to inappropriate interpolation results.
Innovation Solution
A method and motion compensator that inhibit the use of image data from impermissible positions by comparing the referenced image data with predefined permissible image areas, preventing the use of data outside the active image area and replacing it with data from permissible positions to maintain image quality, using motion vectors to interpolate new image data based on predicted image data from adjacent images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion compensation uses image data from referenced positions based on motion vectors, then interpolation accuracy is improved, but image quality deteriorates when referenced data falls outside active image areas
Solution Approach 1:
The patent applies preliminary action by checking whether the referenced image position falls within the active image area before performing the interpolation operation. This pre-check prevents the harmful effect of using invalid data from non-active areas while still allowing the benefits of motion-compensated interpolation when conditions are appropriate.
Solution Approach 2:
The patent applies local quality by treating different spatial regions differently: image positions within the active image area are processed with full motion compensation interpolation, while positions outside the active area are handled separately to avoid quality degradation. This localized approach ensures high quality where it matters while avoiding problems at borders.
2Productivity
If motion vectors are used for all pixel positions including borders, then processing completeness is improved, but interpolation accuracy deteriorates at image borders
Solution Approach 1:
The patent performs a preliminary check to determine if a pixel position lies within the active image area before applying motion compensation. This ensures that only valid positions receive interpolated data from motion vectors, maintaining accuracy where it matters while still processing all positions systematically.
Solution Approach 2:
The patent applies different processing strategies to different regions: pixels within the active image area receive full motion-compensated interpolation for high accuracy, while border pixels outside the active area are handled differently (e.g., using alternative methods or default values), ensuring overall processing completeness without compromising the accuracy of valid regions.
Data Source
AI summary
The present invention relates to an improved interpolation based on motion compensation. In order to avoid interpolation artifacts in proximity to the image borders, in particular in letterbox type images, each motion compensated image data is subjected to a position validation in order to determine whether or not the motion compensated image data can be used for interpolation purposes. By comparing the position of the motion compensated image data in the referenced images with predefined borderlines, impermissible image data positions can be detected and interpolation based on such image data prevented.