Video Frame Block Exclusion for Static Graphic Motion Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video processing methods fail to accurately identify and protect graphic elements from motion compensation, leading to artifacts such as flickering of the graphic object when the video sequence is played out to a user.
Innovation Solution
The processor unit is configured to identify blocks of a video sequence to be excluded from a motion-compensated operation, the processor unit comprising: a frame processor configured to process pixel values of a first frame to characterize blocks of a video sequence to be excluded from a motion-compensated operation, the processor unit comprising: a frame processor configured to process pixel values of a first frame to characterize blocks of a video sequence to be excluded from a motion-compensated operation, the processor unit comprising: a frame processor configured to process pixel values of a first frame to exclude from a motion-compensated operation, the processor unit comprising: a frame processor configured to identify and protect graphic objects in a video sequence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If motion compensation is applied to all blocks in frame rate conversion, then processing completeness is improved, but graphic objects suffer from conversion artifacts and flickering
Solution Approach 1:
The video frame is divided into multiple blocks, and each block is individually analyzed to determine whether it represents a graphic object or natural video content. This segmentation allows selective application of motion compensation only to non-graphic blocks, preventing artifacts while maintaining processing completeness for the rest of the frame.
Solution Approach 2:
Different processing qualities are applied to different regions of the frame based on their content type. Graphic object blocks are excluded from motion compensation to preserve their quality and avoid flickering, while non-graphic blocks receive full motion compensation processing. This local differentiation resolves the contradiction by applying the appropriate processing quality to each region.
2Object-affected harmful factors
If graphic objects are excluded from motion compensation, then artifact reduction is improved, but processing complexity increases due to additional identification steps
Solution Approach 1:
The graphic object identification and exclusion process is performed in advance, during the motion estimation stage, before the actual motion compensation operation. By pre-identifying graphic blocks and marking them for exclusion, the system avoids the need for complex real-time processing decisions during compensation, thereby reducing overall processing complexity while still achieving artifact reduction.
Solution Approach 2:
Graphic object blocks are extracted and separated from the general video processing flow. Once identified, these blocks are taken out of the motion compensation pipeline entirely, allowing the remaining non-graphic blocks to be processed efficiently without the overhead of continuous graphic detection during compensation. This extraction reduces processing complexity by simplifying the main processing path.
3Ease of operation
If all blocks are processed with motion compensation, then processing uniformity is improved, but video quality deteriorates due to flickering of static graphic elements
Solution Approach 1:
The processing approach transitions from a static uniform method to a dynamic adaptive method. The system dynamically determines for each block whether it represents a graphic object or natural content, and adjusts the processing accordingly. This dynamic adaptation allows the system to maintain processing uniformity in terms of workflow while achieving variable processing outcomes that preserve video quality by preventing graphic object flickering.
Data Source
AI summary
Blocks of a video frame to be excluded from a motion-compensated operation are identified, by processing pixel values of a first frame to characterize blocks of the pixels as representing a portion of an object. Difference values between blocks of the first frame and blocks of a second frame are determined, processed difference values characterizing blocks of the first frame as representing an image component that is static between the first and second frames. A score is generated for each block of the first frame indicating a confidence level that the block represents a static image component. Blocks of the first frame are identified as protected blocks which (i) represent a portion of an object; and (ii) represent an image component that is static between the first and second frames. A dilating kernel is applied to blocks with a score indicating a low confidence level and characterizing each block within the kernel as not representing a static image component.