Image Processing Apparatus Block-Level Interpolation Error Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image processing techniques for generating interpolated images often result in erroneous interpolation outcomes due to misjudged motion vectors, leading to abrupt changes and decreased playback smoothness, especially when objects move quickly or change drastically, causing errors in determining motion vectors between frames.
Innovation Solution
An image processing apparatus and method that determines the correctness of interpolated images based on motion vectors for each block, replacing blocks with potential errors using substitutive images to generate a new frame, allowing for a combination of interpolated and non-interpolated blocks in the same frame, thereby reducing erroneous interpolation and enhancing smoothness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If motion vector-based interpolation is applied to generate intermediate frames, then playback smoothness is improved, but interpolation errors occur when objects move quickly or change drastically
Solution Approach 1:
The patent divides the frame into multiple blocks and processes each block independently. For each block, it determines whether to use interpolated images or original images based on motion vector accuracy assessment. This segmentation allows selective application of interpolation only where reliable, preventing error propagation across the entire frame while maintaining high frame rates.
Solution Approach 2:
The patent applies different image sources (interpolated vs. original) to different blocks within the same frame based on local motion characteristics. Blocks with reliable motion vectors use interpolated images for smoothness, while blocks with uncertain motion vectors use original images for accuracy. This local quality approach optimizes both smoothness and reliability at the block level.
2Measurement precision
If the comparison range for motion vector determination is increased to improve accuracy, then motion vector precision improves, but calculation time increases beyond allowed period
Solution Approach 1:
The patent performs partial motion vector verification by checking only critical blocks where interpolation errors are most likely to occur, rather than exhaustively verifying all blocks. This partial action approach achieves sufficient reliability for the most error-prone areas without exceeding calculation time constraints for the entire frame.
Solution Approach 2:
The patent dynamically adjusts the comparison range for motion vector determination based on block characteristics and motion complexity. For simple blocks, a smaller comparison range suffices, reducing calculation time. For complex blocks requiring higher precision, the comparison range is expanded within available time, optimizing the trade-off between precision and speed.
3Reliability
If entire frames are discarded when interpolation errors are detected, then error propagation is prevented, but playback smoothness deteriorates due to repeated original frames
Solution Approach 1:
Instead of discarding entire frames, the patent segments the frame into blocks and selectively replaces only the erroneous blocks with original images while retaining correctly interpolated blocks. This segmentation prevents error propagation locally without sacrificing the smoothness benefits of interpolation in the rest of the frame.
Solution Approach 2:
The patent extracts and removes only the specific erroneous blocks from the interpolated frame, replacing them with original image blocks. This extraction approach eliminates the harmful error elements while preserving the beneficial interpolated content in non-erroneous blocks, maintaining both reliability and smoothness.
Data Source
AI summary
An image processing apparatus for generating an intermediate frame according to a previous frame and a next frame is provided. The apparatus includes a determining module and a selecting module. The intermediate frame includes a plurality of intermediate image blocks, each of which corresponds to a motion vector. For each intermediate image block, the determining module determines whether an interpolated image generated according to the motion vector meets a correctness requirement. According to whether the interpolated image meets the correctness requirement, the selecting module selects the interpolated image or a substitutive image different from the interpolated image to represent the intermediate image block.