Digital Image Deblurring via PSF Estimation and FFT

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for addressing optical aberrations, camera shake, and atmospheric blur are computationally prohibitive and inefficient, particularly in real-time applications, due to the complexity of estimating linear transformations required for blind deconvolution.

Innovation Solution

The use of space-invariant and space-variant Point Spread Functions (PSFs) for efficient linear filtering, allowing for chunking of images into patches and application of the overlap-add method, which enables fast matrix-vector multiplications through Discrete Fourier Transform techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If general linear transformation estimation is used for blind deconvolution, then deblurring capability is improved, but computational complexity becomes prohibitive

Engineering Contradiction:
Improvedeblurring capabilityVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the image into multiple overlapping patches and processes each patch independently through the linear filter. This segmentation allows the computationally intensive deblurring operation to be performed on smaller, manageable units rather than the entire image at once, reducing memory requirements and enabling parallel processing while maintaining overall deblurring effectiveness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the computational approach by changing from direct spatial domain convolution to frequency domain multiplication using Fast Fourier Transform. This parameter change in the mathematical domain converts an O(n²) operation into an O(n log n) operation, dramatically reducing computational complexity while preserving the deblurring capability through the equivalence of convolution in spatial domain and multiplication in frequency domain.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If space-variant PSFs are used for different image patches, then deblurring accuracy is improved, but processing complexity increases

Engineering Contradiction:
Improvedeblurring accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies different Point Spread Functions to different spatial regions (patches) of the image, allowing each local region to be deblurred with a filter optimized for its specific characteristics. This local quality approach improves deblurring accuracy in regions with varying blur patterns while keeping the overall system manageable by processing patches independently rather than requiring a single complex global solution.

Inventive Principle:
Principle #3Local quality

3Productivity

If chunking method is applied for efficient MVM, then processing speed is improved, but implementation complexity increases

Engineering Contradiction:
Improveprocessing speedVSAvoidimplementation complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements chunking by dividing the image into overlapping patches that can be processed independently and in parallel. Each patch is transformed to frequency domain, multiplied by the appropriate PSF, and transformed back. This segmentation enables efficient matrix-vector multiplication through parallel processing while the overlap ensures continuity and avoids boundary artifacts, balancing speed improvement with manageable implementation complexity.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for efficient deblurring of images with low resource requirements, enabling online processing and dynamic deblurring, while maintaining expressiveness and simplicity in implementation.

Implementation Method 1

If q is the size of the FFT for the patches, then OLA costs O(n log q)

Methodology Applied
Scientific EffectDiscrete Fourier Transform:

Data Source

PatentUS10032254B2Method and device for recovering a digital image from a sequence of observed digital images
Publication Date: 2018.07.24 MAX PLANCK GESELLSCHAFT ZUR FOERDERUNG DER WISSENSCHAFTEN EV
  • US10032254B2 patent drawing
  • US10032254B2 patent drawing
  • US10032254B2 patent drawing

AI summary

A computer-implemented method for recovering a digital image (x) from a sequence of observed digital images (y1, . . . , yT), includes: obtaining an observed digital image (yt); estimating a point spread function (ft) based on the observed image (yt); estimating the recovered digital image (x), based on the estimated point spread function (ft) and the observed image (yt); and repeating the above steps. In order to correct optical aberrations of a lens, a point spread function of the lens may be used.