Realtime 2D Deconvolution Using PSF Reuse

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems fail to effectively enhance the resolution, contrast, and clarity of two-dimensional images in real-time due to image degradation from optical limitations and computational resource constraints, particularly in microscopy applications where image sequences require significant processing.

Innovation Solution

A system utilizing both blind and non-blind deconvolution algorithms processes a stream of images, where the blind deconvolution algorithm calculates an initial point spread function (PSF) for subsequent images, allowing for real-time enhancement through a less computationally intensive non-blind deconvolution process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If blind deconvolution algorithms are used to improve image quality, then image resolution and clarity are enhanced, but computational resources and processing time increase significantly

Engineering Contradiction:
Improveimage resolutionVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary calibration to measure the point spread function (PSF) once for each objective lens and stores it for reuse. This preliminary measurement eliminates the need for repeated blind deconvolution computations during actual image processing, achieving both high image quality and real-time processing speeds.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of repeatedly performing computationally intensive blind deconvolution to estimate the PSF for each image, the system creates a copy of the measured PSF and reuses it across multiple images taken with the same objective lens. This copying approach maintains image enhancement quality while dramatically reducing computational burden.

Inventive Principle:
Principle #26Copying

2Reliability

If blind deconvolution is performed on each image in a sequence, then each image is enhanced, but real-time processing becomes infeasible due to computational intensity

Engineering Contradiction:
Improveimage enhancement qualityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs the computationally intensive PSF measurement once during calibration before processing image sequences. This preliminary action allows subsequent images to be processed quickly using the pre-measured PSF, enabling real-time playback of enhanced image sequences without sacrificing enhancement quality.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If users calibrate the system by measuring blur for each image, then accurate deconvolution is achieved, but the process becomes cumbersome and slow

Engineering Contradiction:
Improveblur measurement accuracyVSAvoidcalibration complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs blur measurement (PSF characterization) once during an initial calibration phase for each objective lens and stores the results. This eliminates the need for users to repeatedly measure blur for each subsequent image, dramatically simplifying operation while maintaining measurement accuracy through the use of the pre-measured PSF.

Inventive Principle:
Principle #10Preliminary action

4Adaptability or versatility

If optical microscopy objectives are used beyond their design conditions, then more versatile imaging is achieved, but severe spherical aberration is induced

Engineering Contradiction:
Improveimaging flexibilityVSAvoidspherical aberration
Core Design Contradiction:
Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The system uses measured PSF data as feedback to characterize and correct for spherical aberration and other optical degradations. By measuring the actual PSF under specific imaging conditions and using it for deconvolution, the system compensates for aberrations introduced when objectives are used outside their ideal design conditions, maintaining image quality across diverse applications.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS7602989B2Realtime 2D deconvolution system and method
Publication Date: 2009.10.13 MEDIA CYBERNETICS
  • US7602989B2 patent drawing
  • US7602989B2 patent drawing
  • US7602989B2 patent drawing

AI summary

A real time 2D deconvolution system and method for processing a time sequence, or video sequence, of microscopy images. A system is provided that includes a first algorithm for processing a first image in the set of 2D images, wherein the first algorithm calculates an estimated point spread function (PSF) by analyzing data in the first image; and a second algorithm for processing a set of subsequent images in the set of 2D images, wherein each subsequent image is processed based on the estimated PSF, under the assumption of slowly-varying image change. A PSF refinement system may optionally improve the PSF estimate, between each image, as computation time permits.