Auto-referencing Digital Holographic Microscopy Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital holographic microscopy (DHM) systems face challenges in maintaining accurate reconstruction of cell images due to drifts and complexity in maintaining reference holograms, especially in flow cells, which affects the measurement of mean cell volume (MCV) and other diagnostic techniques.

Innovation Solution

The implementation of auto-referencing techniques in DHM reconstruction, where a reference image is extracted from a time series of images, and disturbed fringe patterns are replaced with patterns from other parts of the image, using methods like dictionary learning, image in-painting, and filtering algorithms to create a stable background for accurate optical depth mapping.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional reference beam methods are used in DHM systems, then hologram reconstruction is possible, but drifts and complexity in maintaining reference holograms occur especially in flow cells

Engineering Contradiction:
Improvereconstruction accuracyVSAvoidreference hologram maintenance
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system automatically extracts reference information from the hologram data itself without requiring external reference beams or manual reference updates. The algorithm identifies and utilizes stable background regions within the flow cell to generate reference holograms dynamically, making the system self-sufficient and eliminating complex external reference maintenance

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The method extracts reference hologram information directly from the object hologram data by identifying stable background regions. This extraction approach separates the reference information generation from the measurement process, allowing automatic reference creation without interfering with the actual cell measurement

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If frequent reference image updates are performed, then reconstruction accuracy is maintained, but computational complexity and maintenance efforts increase

Engineering Contradiction:
ImproveMCV measurement accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs self-updating of reference images by automatically identifying stable background regions in each new hologram dataset. This self-service mechanism maintains measurement precision without requiring external intervention or complex computational processes, as the reference update is embedded in the normal measurement workflow

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Instead of updating the entire reference image frequently, the method performs partial updates by only processing stable background regions. This reduces computational complexity while maintaining sufficient accuracy for MCV measurements, avoiding the excessive computational burden of complete reference image regeneration

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If stable background regions are used for reference extraction, then artifacts in reconstructed images are reduced, but image processing complexity increases

Engineering Contradiction:
Improvereconstruction qualityVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The method segments the hologram image into object regions and stable background regions, processing each differently. This segmentation allows targeted extraction of reference information from stable areas without requiring complex processing of the entire image, reducing overall processing complexity while maintaining reconstruction quality

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The approach applies different processing qualities to different regions: stable background regions undergo reference extraction processing while object regions maintain their full detail. This local quality differentiation reduces artifacts in the final reconstruction without requiring uniform high-level processing across the entire image, balancing quality and complexity

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach minimizes the need for frequent reference image updates, reduces artifacts in reconstructed images, and maintains high accuracy in measuring MCV and other diagnostic parameters with reduced computational complexity and maintenance efforts.

Implementation Method 1

plane waves impinging a sensor surface interfere destructively and constructively at the location at the sensor and thus forming the sinusoidal pattern

Methodology Applied
Scientific EffectInterference: Interference

Data Source

PatentEP3353606B1Auto-referencing in digital holographic microscopy reconstruction
Publication Date: 2024.03.13 SIEMENS HEALTHINEERS AG
  • EP3353606B1 patent drawingFigure 1A
  • EP3353606B1 patent drawingFigure 1B
  • EP3353606B1 patent drawingFigure 2

AI summary

A computer-implemented method for analyzing digital holographic microscopy (DHM) data for hematology applications includes receiving a DHM image acquired using a digital holographic microscopy system. The DHM image comprises depictions of one or more cell objects and background. A reference image is generated based on the DHM image. This reference image may then be used to reconstruct a fringe pattern in the DHM image into an optical depth map.