Deep Unfolding Denoising for CT Images with Sparse Representations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image denoising techniques for medical imaging, such as CT scans, face challenges in balancing noise reduction with real-time processing efficiency, especially when dealing with low-dose radiation, where traditional methods lead to blurred edges and high computational costs, limiting their applicability in interventional surgeries.

Innovation Solution

A deep learning-based approach using a multiscale network of filters with sparse denoising autoencoders, where each layer is trained independently to decompose and reconstruct images, reducing noise while maintaining image quality and processing speed through iterative thresholding and patch-based learning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If traditional denoising filters (e.g., simple averaging filters) are used, then noise is reduced, but edges and details become blurred

Engineering Contradiction:
ImprovenoiseVSAvoidedge sharpness
Core Design Contradiction:
Object-affected harmful factorsVSManufacturing precision

Solution Approach 1:

The image is divided into multiple scales/levels of detail. The denoising process operates at different scales, with coarse scales capturing global structures and fine scales preserving local edges. This segmentation allows noise reduction without blurring important edge details.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different denoising strengths are applied to different regions of the image based on local characteristics. Edge regions receive less aggressive denoising to preserve sharpness, while homogeneous regions receive stronger denoising to remove noise effectively.

Inventive Principle:
Principle #3Local quality

2Object-affected harmful factors

If advanced denoising algorithms (e.g., BM3D, BM4D) are used, then denoising quality is improved, but computational expense increases

Engineering Contradiction:
Improvenoise reduction qualityVSAvoidcomputational expense
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The image processing is divided into multiple scales, with each scale processed independently. This segmentation allows the use of simpler, faster algorithms at each scale while achieving overall high-quality denoising through the combination of multi-scale results.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of applying one complex denoising algorithm to the entire image, the method applies simpler denoising operations partially at multiple scales. The cumulative effect of these partial actions achieves superior denoising quality with reduced computational cost compared to a single comprehensive algorithm.

Inventive Principle:
Principle #16Partial or excessive action

3Object-affected harmful factors

If pure data-driven deep learning approaches are used, then denoising performance is improved, but flexibility is reduced due to dependency on acquisition parameters

Engineering Contradiction:
Improvedenoising performanceVSAvoidflexibility
Core Design Contradiction:
Object-affected harmful factorsVSAdaptability or versatility

Solution Approach 1:

The multi-scale denoising framework is designed to be universal and adaptable to different imaging modalities and acquisition parameters. By operating at multiple scales rather than relying on parameter-specific training, the system can effectively denoise images from various CT scanners and protocols without requiring retraining.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The method changes the approach from learning fixed parameters to learning scale-dependent transformations. By operating in the scale domain rather than relying on acquisition-specific parameters, the system gains flexibility to adapt to different imaging conditions while maintaining high denoising performance.

Inventive Principle:
Principle #35Parameter changes

4Object-affected harmful factors

If deep learning is applied to large 3D volumes, then denoising quality is improved, but processing time increases making real-time application difficult

Engineering Contradiction:
Improvedenoising qualityVSAvoidprocessing time
Core Design Contradiction:
Object-affected harmful factorsVSLoss of time

Solution Approach 1:

The large 3D volume is segmented into multiple smaller 2D slices or sub-volumes processed at different scales. This segmentation reduces the computational burden on each processing step while maintaining overall denoising quality through the integration of multi-scale results.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The method transitions from processing the entire 3D volume at once to processing 2D slices at multiple scales. By adding the scale dimension and processing lower-dimensional slices, the computational complexity is reduced while still achieving effective 3D denoising through the accumulation of multi-scale information.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10692189B2Denoising medical images by learning sparse image representations with a deep unfolding approach using scan specific metadata
Publication Date: 2020.06.23 SIEMENS HEALTHINEERS AG
  • US10692189B2 patent drawing
  • US10692189B2 patent drawing
  • US10692189B2 patent drawing

AI summary

The present embodiments relate to denoising medical images. By way of introduction, the present embodiments described below include apparatuses and methods for machine learning sparse image representations with deep unfolding and deploying the machine learnt network to denoise medical images. Iterative thresholding is performed using a deep neural network by training each layer of the network as an iteration of an iterative shrinkage algorithm. The deep neural network is randomly initialized and trained independently with a patch-based approach to learn sparse image representations for denoising image data. The different layers of the deep neural network are unfolded into a feed-forward network trained end-to-end.