Image Processing Device Halo Artifact Removal via Block Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods, such as unsharp masking, face challenges in enhancing image contrast while encountering halo artifacts near boundaries and struggling with limited local contrast enhancement effects, especially when blurring images are extensively or minimally taken.

Innovation Solution

An image processing device and method that obtain a first blurring image through interpolation based on representative values of blocks in a previous frame image and a second blurring image with restored boundary information via a weighted sum of the current and first blurring images, effectively removing halo artifacts and enhancing contrast.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If unsharp masking is used for local contrast enhancement, then contrast enhancement effect is improved, but halo artifact occurs near boundary

Engineering Contradiction:
Improvecontrast enhancement effectVSAvoidhalo artifact
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

The image is divided into multiple blocks, and each block is processed separately to calculate local statistics (mean and standard deviation). This segmentation allows the algorithm to apply different processing to different regions, preventing halo artifacts at boundaries while maintaining contrast enhancement within each block.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local contrast enhancement by calculating statistics specific to each block rather than using global statistics. The contrast enhancement amount is determined locally based on block-specific mean and standard deviation values, ensuring that each region is enhanced appropriately without causing halo artifacts at boundaries.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If blurring image is taken extensively, then contrast enhancement effect is improved, but halo artifact occurs near boundary

Engineering Contradiction:
Improvecontrast enhancement effectVSAvoidhalo artifact
Core Design Contradiction:
Manufacturing precisionVSObject-generated harmful factors

Solution Approach 1:

Instead of extensively blurring the entire image, the patent segments the image into blocks and performs localized processing. This prevents the propagation of boundary information that causes halo artifacts while still achieving sufficient contrast enhancement within each local region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses local statistics from each block to determine contrast enhancement parameters rather than using extensive global blurring. This localized approach maintains contrast enhancement effectiveness while avoiding the halo artifacts that result from extensive boundary-inclusive blurring.

Inventive Principle:
Principle #3Local quality

3Object-generated harmful factors

If blurring image is taken within small range, then halo artifact is reduced, but contrast enhancement effect is insufficient

Engineering Contradiction:
Improvehalo artifactVSAvoidcontrast enhancement effect
Core Design Contradiction:
Object-generated harmful factorsVSManufacturing precision

Solution Approach 1:

The patent segments the image into blocks and processes each block independently with its own local statistics. This segmentation allows sufficient local contrast enhancement within each block without the need for extensive blurring that would cause halo artifacts at boundaries.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

By calculating contrast enhancement parameters locally for each block based on block-specific statistics, the patent achieves sufficient contrast enhancement effect without requiring extensive blurring. This local processing approach avoids halo artifacts while maintaining enhancement effectiveness.

Inventive Principle:
Principle #3Local quality

4Manufacturing precision

If large frame buffers are used to store blurring images, then contrast enhancement effect is improved, but hardware cost is increased

Engineering Contradiction:
Improvecontrast enhancement effectVSAvoidhardware cost
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing into blocks that can be processed independently and in sequence. This allows the system to process one block at a time rather than requiring entire frame buffers to store all blurring images, significantly reducing hardware memory requirements while maintaining contrast enhancement effectiveness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

By using local statistics from each block rather than global statistics requiring extensive image storage, the patent achieves contrast enhancement with minimal buffer requirements. Only the current block and its statistics need to be stored, eliminating the need for large frame buffers.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11222412B2Image processing device and method
Publication Date: 2022.01.11 SILICON WORKS CO LTD
  • US11222412B2 patent drawing
  • US11222412B2 patent drawing
  • US11222412B2 patent drawing

AI summary

The disclosure provides an image processing device and method capable of removing a halo artifact and increasing contrast enhancement effect when enhancing the contrast of an image. The image processing method includes obtaining a first blurring image by performing interpolation based on a representative value of each of blocks, having a predetermined size, of a previous frame image; obtaining a second blurring image in which boundary information is restored, through a weighted sum of a current frame image and the first blurring image; and performing contrast enhancement on the current frame image by using a difference image between the second blurring image and the current frame image.