Judder-Map Based Image Interpolation for CGI and Subtitles
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Judder artifacts occur in CGI and subtitles when pulldown technologies are not applied, particularly due to the conversion of progressive film formats to interlaced video signals, leading to blurred edges and irregularities in image scanning.
Innovation Solution
An image processing apparatus and method utilizing a judder-map to detect and prevent judder by determining whether an input image is in film mode, generating a judder-map to identify judder in pixels or blocks, and performing spatial or temporal interpolation based on the judder-map to convert interlaced images to progressive format.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 3:2 pulldown conversion is applied to convert progressive film frames to interlaced video fields, then compatibility with interlaced display devices is improved, but judder artifacts are generated in CGI and subtitles where pulldown is not applied
Solution Approach 1:
The patent applies different processing methods to different regions of the image based on local characteristics. The judder detection unit identifies specific blocks or regions where judder occurs, and the processing unit applies selective deinterlacing only to those regions, while leaving other regions processed with standard pulldown conversion. This localized approach prevents judder artifacts in CGI and subtitles without compromising overall compatibility with interlaced display devices.
2Manufacturing precision
If standard deinterlacing is applied to convert interlaced images to progressive format, then image quality is improved, but judder artifacts remain in regions where pulldown technology was not originally applied
Solution Approach 1:
The patent performs judder detection and classification before the actual deinterlacing process. The judder detection unit analyzes the interlaced image in advance to identify regions with judder characteristics, and the processing unit uses this pre-acquired information to apply appropriate deinterlacing methods. This preliminary detection allows the system to prevent judder artifacts in the final progressive output by selecting suitable processing strategies for each region beforehand.
3Device complexity
If pulldown technology is applied uniformly to all image regions, then interlaced-to-progressive conversion is simplified, but judder artifacts are introduced in regions where pulldown was not originally applied such as CGI and subtitles
Solution Approach 1:
The patent implements region-specific processing by detecting judder characteristics in different blocks of the image and applying different deinterlacing methods accordingly. Regions identified as having judder characteristics (such as CGI and subtitles) receive specialized processing, while other regions use standard conversion methods. This local differentiation resolves the contradiction between processing simplicity and artifact prevention.
4Productivity
If no judder detection is performed, then processing speed is maintained, but judder artifacts are not prevented in the output image
Solution Approach 1:
The patent divides the image into multiple blocks and performs judder detection on a block-by-block basis rather than processing the entire image uniformly. This segmentation allows the system to quickly identify regions with judder characteristics using efficient block-level analysis, and apply selective processing only where needed. The segmented approach maintains processing speed by avoiding exhaustive analysis of all image regions while still preventing judder artifacts in affected areas.
Data Source
AI summary
An image processing apparatus using a judder-map and a method thereof. The image processing apparatus using a judder-map includes: a field storage block to receive an input interlaced video signal including an input image having a plurality of consecutive fields, a film detecting block to receive the plurality of the consecutive fields from the field storage block and to detect whether the input image is an image in a film mode, a judder-map generating block to detect judder created on a pixel or block of neighboring fields among the plurality of consecutive fields provided from the field storage block to generate a judder-map, and an image interpolating block to perform image interpolation using the judder-map if the input video signal is detected to be an image in the film mode and to generate and output a progressive video signal. The image processing apparatus prevents the creation of judder on CGI (Computer Graphic Imagery) or subtitles, to which pulldown technologies are not applied.