Fog Removal Image Processing via Pixel-Block Transmission Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Outdoor surveillance cameras face consistent picture quality degradation due to fog and smog, which existing image processing methods fail to address effectively, especially in moving images where fog components are uniformly distributed across the entire image.

Innovation Solution

An image processing apparatus and method that estimates and removes fog components by synthesizing pixel-based and block-based transmissions using a dark channel prior, calculating airlight, and interpolating transmissions to improve image quality, reducing hardware resource usage and enabling real-time processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If pixel-based transmission estimation is applied to current images, then fog removal accuracy is improved, but computational complexity and hardware resource usage increase

Engineering Contradiction:
Improvefog removal accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the transmission estimation into two segments: pixel-based transmission estimation for current images and block-based transmission estimation for previous images. This segmentation allows the system to use computationally intensive pixel-based methods only where needed (current image fog removal) while using simpler block-based methods for historical data, thereby reducing overall computational complexity while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs block-based transmission estimation on previous images in advance, storing these pre-computed transmissions for later use. This preliminary action reduces the computational burden during real-time processing of current images, as the system can reuse pre-computed block transmissions rather than recomputing everything from scratch.

Inventive Principle:
Principle #10Preliminary action

2Device complexity

If block-based transmission estimation is applied to previous images, then hardware resource usage is reduced, but transmission accuracy for current pixels may deteriorate

Engineering Contradiction:
Improvehardware resource usageVSAvoidtransmission accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent merges pixel-based transmission estimation (for current pixels) and block-based transmission estimation (for previous images) into a unified transmission model. The synthesizing unit combines both estimation results, allowing the system to leverage the computational efficiency of block-based methods while maintaining the accuracy of pixel-based methods where needed.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces an interpolation unit as an intermediary that bridges block-based and pixel-based transmission estimations. This intermediary component smoothly transitions between the coarser block-based transmissions and finer pixel-based transmissions, ensuring that the combined transmission model maintains accuracy while reducing hardware resource requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If fog component is uniformly distributed across the entire image, then image processing complexity is reduced, but existing image processing methods fail to address it effectively

Engineering Contradiction:
Improveimage processing complexityVSAvoidfog removal effectiveness
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent applies different transmission estimation strategies to different parts of the image based on their specific characteristics. Current pixels use pixel-based estimation for local accuracy, while previous image blocks use block-based estimation for efficiency. This local differentiation allows the system to handle uniform fog distribution effectively while maintaining the ability to process complex local variations when they occur.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9280808B2Method and apparatus for processing image
Publication Date: 2016.03.08 HANWHA VISION CO LTD
  • US9280808B2 patent drawing
  • US9280808B2 patent drawing
  • US9280808B2 patent drawing

AI summary

Provided are a method and apparatus for processing an image to remove fog from the image. The apparatus for processing an image includes: a transmission estimation unit configured to calculate a transmission of an input image by synthesizing pixel-based transmissions of current pixels of the current image including a fog component, and block-based transmissions of a plurality of blocks of a previous image, each block including a plurality of pixels; an airlight estimation unit configured to calculate airlight of the input image; and an image restoration unit configured to generate, based on the transmission and the airlight, a restored image in which the fog component is removed from the current image.