Deep Unfolding Algorithm for Image Denoising

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image denoising algorithms are inefficient under varying noise conditions, particularly in low-dose medical images, as they either rely on slow iterative solvers or produce artifacts when dealing with high noise levels, and lack adaptability to different noise distributions.

Innovation Solution

A deep unfolding algorithm using a multiscale patch-based image representation within a neural network that applies threshold-based denoising, scaling thresholds according to noise levels and using a learned dictionary for sparse representation, allowing a single network to handle multiple noise levels and distributions without retraining.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If iterative solvers are used for image denoising, then denoising quality is improved, but processing speed deteriorates

Engineering Contradiction:
Improvedenoising qualityVSAvoidprocessing speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The image is divided into multiple patches, and each patch is processed independently through the neural network. This segmentation allows parallel processing of patches, significantly improving processing speed while maintaining denoising quality through localized analysis of image regions

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The traditional iterative mathematical solver is replaced with a neural network-based system that learns denoising patterns from training data. This substitution transforms the computational approach from iterative optimization to direct inference, achieving both high denoising quality and fast processing speeds

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If patch-based denoising is applied, then denoising quality is improved, but processing time increases due to slow nearest-neighbor search

Engineering Contradiction:
Improvedenoising qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The computationally expensive nearest-neighbor search is replaced with a neural network that directly processes patches. The network learns to identify and denoise patches based on learned features rather than exhaustive similarity searches, dramatically reducing processing time while maintaining or improving denoising quality

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The neural network is pre-trained on a large dataset of image patches during an offline training phase. This preliminary action allows the network to learn effective denoising strategies in advance, so that during actual processing, patches can be denoised quickly using the pre-learned knowledge without requiring complex real-time searches

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If multiple networks are used for different noise levels, then adaptability to varying noise conditions is improved, but device complexity increases

Engineering Contradiction:
Improveadaptability to noise levelsVSAvoidnetwork complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The neural network incorporates dynamic thresholding where the denoising strength is automatically adjusted based on the estimated noise level of each patch. This dynamic adaptation allows a single network to effectively handle varying noise conditions without requiring multiple fixed networks, reducing complexity while maintaining versatility

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The network uses noise level estimation as a key parameter to adapt its processing. By estimating the noise level for each patch and adjusting the denoising threshold accordingly, the system achieves adaptability to different noise conditions through parameter modulation rather than through structural complexity of multiple networks

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10043243B2Deep unfolding algorithm for efficient image denoising under varying noise conditions
Publication Date: 2018.08.07 SIEMENS HEALTHINEERS AG
  • US10043243B2 patent drawing
  • US10043243B2 patent drawing
  • US10043243B2 patent drawing

AI summary

A computer-implemented method for denoising image data includes a computer system receiving an input image comprising noisy image data and denoising the input image using a deep multi-scale network comprising a plurality of multi-scale networks sequentially connected. Each respective multi-scale network performs a denoising process which includes dividing the input image into a plurality of image patches and denoising those image patches over multiple levels of decomposition using a threshold-based denoising process. The threshold-based denoising process denoises each respective image patch using a threshold which is scaled according to an estimation of noise present in the respective image patch. The noising process further comprises the assembly of a denoised image by averaging over the image patches.