Video Frame Block Protection for Static Graphic Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video frame rate converters often introduce conversion artefacts in static graphic objects due to incorrect motion estimation, leading to perceptual issues like flickering when interpolating frames.
Innovation Solution
A processor unit identifies blocks in a video frame representing graphic objects and static image components, excluding them from motion compensation to prevent artefacts by generating a protective key signal and performing non-motion compensated blending.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If motion compensation is applied during frame rate conversion, then the smoothness of moving objects is improved, but conversion artefacts appear in static graphic objects
Solution Approach 1:
The video frame is divided into multiple blocks, and each block is independently analyzed to determine whether it contains static graphic objects. This segmentation allows selective application of motion compensation only to blocks that do not contain static graphic objects, thereby preventing conversion artefacts while maintaining smoothness in moving regions.
Solution Approach 2:
Different processing strategies are applied to different regions of the video frame based on their characteristics. Blocks identified as containing static graphic objects are excluded from motion compensation, while other blocks receive full motion compensation processing. This local differentiation resolves the contradiction by applying the right processing to the right region.
2Measurement precision
If motion estimation is performed on all blocks, then the accuracy of motion tracking is improved, but static graphic objects are incorrectly identified as moving
Solution Approach 1:
Before performing motion estimation, the method first identifies blocks containing static graphic objects using frame difference analysis and other preliminary tests. This preliminary action prevents subsequent motion estimation from incorrectly tracking static graphic objects as moving, thereby maintaining both measurement precision and reliability.
Solution Approach 2:
The system uses feedback from frame difference calculations and block analysis to continuously refine the identification of static graphic objects. By comparing current frame blocks with previous frame blocks and analyzing the results, the system adjusts its identification accuracy, ensuring that static graphic objects are reliably distinguished from actually moving objects.
3Productivity
If frame interpolation is used to increase frame rate, then the perceptual smoothness is improved, but artefacts appear in static graphic objects
Solution Approach 1:
The frame interpolation process is segmented to handle different block types differently. Blocks containing static graphic objects are identified and excluded from motion-compensated interpolation, while other blocks undergo full interpolation processing. This segmentation enables high frame rate conversion while preventing artefacts in static graphic regions.
Solution Approach 2:
The processing parameters for frame interpolation are changed based on block characteristics. For blocks containing static graphic objects, motion compensation parameters are adjusted or disabled, while other blocks use standard interpolation parameters. This dynamic parameter adjustment resolves the contradiction between high frame rate and artefact-free output.
Data Source
AI summary
A processor unit configured to identify blocks of a frame of a video sequence to be excluded from a motion-compensated operation, includes a frame processor configured to process pixel values of a first frame to characterise blocks of one or more pixels of the first frame as representing at least a portion of a graphic object; a frame-difference processor configured to determine difference values between blocks of the first frame and corresponding blocks of a second frame, and to process said difference values to characterise blocks of the first frame as representing an image component that is static between the first and second frames; a block identifier configured to identify blocks of the first frame as protected blocks in dependence on blocks characterised as: (i) representing at least a portion of a graphic object; and (ii) representing an image component that is static between the first and second frames, wherein the identified protected blocks are to be excluded from the motion compensated operation.