Image Processing Apparatus for Multiple-Fold Frame Rate Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional motion detection and motion compensation technologies are limited to double frame rate conversion and suffer from low motion vector search accuracy, resulting in suboptimal image quality for display devices with refresh rates like 60 Hz or 120 Hz.
Innovation Solution
An image processing apparatus that calculates motion vectors for multiple-fold frame rate conversion by acquiring and correlating blocks from input and delayed image data, ensuring high-accuracy motion vector search and improved image quality through interpolation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional motion detection technology is used for frame rate conversion, then double frame rate conversion can be achieved, but it cannot support multiple-fold frame rate conversion for display devices with refresh rates like 60 Hz or 120 Hz
Solution Approach 1:
The patent introduces dynamic time ratio calculation based on the relationship between input frame rate and display refresh rate. The time ratio is dynamically determined as the reciprocal of the multiplication factor (1/n), allowing the system to adapt to different frame rate conversion scenarios (2x, 3x, 4x, etc.) while maintaining compatibility with various display device refresh rates.
Solution Approach 2:
The patent changes the temporal parameter by introducing delayed image data from a specific time point (third time) that is earlier than the input image data (first time) by a duration determined by the time ratio. This parameter change enables the motion compensation to account for the actual time difference between frames in multiple-fold conversion scenarios.
2Productivity
If conventional motion detection processing is used, then motion vectors can be calculated, but the motion vector search accuracy is low resulting in deteriorated image quality
Solution Approach 1:
The patent performs preliminary action by acquiring delayed image data at a specifically calculated time point before the input image data, based on the time ratio derived from the frame rate conversion factor. This preliminary acquisition of temporally appropriate reference data enables more accurate motion vector calculation without compromising processing efficiency.
Solution Approach 2:
The patent incorporates feedback by using the calculated time ratio to determine both the acquisition timing of delayed image data and the position of blocks in the delayed image data. The system continuously adjusts the timing and positioning based on the frame rate conversion requirements, improving motion vector accuracy through iterative refinement.
3Productivity
If motion compensation processing is performed with low accuracy motion vectors, then interpolated image data can be generated, but the image quality deteriorates making viewers feel uncomfortable
Solution Approach 1:
The patent performs preliminary action by pre-calculating the optimal acquisition time for delayed image data based on the time ratio (1/n) before motion compensation processing. This ensures that the reference data used for interpolation is temporally aligned with the conversion requirements, improving image quality without adding computational overhead during the interpolation stage.
Solution Approach 2:
The patent replaces the conventional mechanical approach of uniform frame spacing with a temporally adaptive system that calculates precise acquisition timings based on the frame rate conversion factor. This substitution of fixed mechanical timing with calculated temporal positioning improves interpolation accuracy while maintaining processing efficiency.
Data Source
AI summary
When first input image and second input image are input to generate an interpolated image, based on search basis position of the interpolated image, correlation between a block based on the first image as reference and a block based on the second input image as reference is acquired to calculate a motion vector.