Simultaneous Multi-Modal Microscopy for Digital Tissue Staining

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for digitally staining biological tissue probes require precise alignment of image pairs, leading to inefficient processing times and potential artifacts due to morphological differences, and often rely on single imaging modalities which limit image quality and frame rate.

Innovation Solution

The method employs simultaneous multi-modal microscopy to generate digitally stained images, eliminating the need for precise alignment and incorporating multiple imaging modalities to enhance image quality and processing speed, while using artificial intelligence systems trained with unaligned image pairs to predict digitally stained images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If sequential imaging of multiple modalities is used, then comprehensive tissue information is obtained, but processing time increases and frame rate decreases

Engineering Contradiction:
Improvetissue information completenessVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent combines multiple imaging modalities (transmission light, reflection light, fluorescence) into a single simultaneous imaging system. The microscope is configured with multiple light sources and detection channels that operate concurrently on the same tissue section, merging the capabilities of separate imaging systems into one unified platform that captures all modalities at the same time point.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system enables continuous simultaneous acquisition of multiple imaging modalities without sequential processing delays. By using parallel detection channels and synchronized imaging, the system maintains continuous useful action across all modalities, eliminating the time losses associated with sequential scanning and processing of different imaging types.

Inventive Principle:
Principle #20Continuity of useful action

2Loss of information

If sequential imaging of multiple modalities is used, then comprehensive tissue information is obtained, but frame rate decreases

Engineering Contradiction:
Improvetissue information completenessVSAvoidframe rate
Core Design Contradiction:
Loss of informationVSSpeed

Solution Approach 1:

The patent combines multiple imaging modalities (transmission light, reflection light, fluorescence) into a single simultaneous imaging system. The microscope is configured with multiple light sources and detection channels that operate concurrently on the same tissue section, merging the capabilities of separate imaging systems into one unified platform that captures all modalities at the same time point.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system enables continuous simultaneous acquisition of multiple imaging modalities without sequential processing delays. By using parallel detection channels and synchronized imaging, the system maintains continuous useful action across all modalities, eliminating the time losses associated with sequential scanning and processing of different imaging types.

Inventive Principle:
Principle #20Continuity of useful action

3Manufacturing precision

If precisely aligned image pairs are used for training, then accurate digital staining is achieved, but processing complexity and time increase

Engineering Contradiction:
Improvedigital staining accuracyVSAvoidimage alignment complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary co-registration of multiple imaging modalities during the image acquisition phase itself. By synchronizing the imaging process and capturing all modalities simultaneously on the same tissue section, the alignment is established beforehand, eliminating the need for complex post-acquisition registration procedures.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses the tissue section itself as an intermediary reference for aligning multiple imaging modalities. Since all images are captured from the identical physical tissue section, the tissue morphology serves as a natural registration template, simplifying the alignment process compared to using separate tissue sections that would require complex computational matching.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Ease of manufacture

If overlying sections are used for imaging, then staining and unstained images can be obtained, but morphological differences cause misalignment and artifacts

Engineering Contradiction:
Improvestaining process simplicityVSAvoidimage alignment precision
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The system performs preliminary co-registration of multiple imaging modalities during the image acquisition phase itself. By synchronizing the imaging process and capturing all modalities simultaneously on the same tissue section, the alignment is established beforehand, eliminating the need for complex post-acquisition registration procedures.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses the tissue section itself as an intermediary reference for aligning multiple imaging modalities. Since all images are captured from the identical physical tissue section, the tissue morphology serves as a natural registration template, simplifying the alignment process compared to using separate tissue sections that would require complex computational matching.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240020955A1Imaging method and system for generating a digitally stained image, training method for training an artificial intelligence system, and non-transitory storage medium
Publication Date: 2024.01.18 PROSPECTIVE INSTR GMBH
  • US20240020955A1 patent drawing
  • US20240020955A1 patent drawing
  • US20240020955A1 patent drawing

AI summary

In one aspect, the invention concerns an imaging method for generating a digitally stained image (51′) of a biological tissue probe (50) from a physical image (50′) of an unstained tissue biological tissue probe (50) in which a physical image (50′) of a biological tissue probe (50) is obtained by simultaneous multi-modal microscopy (53). In another aspect, the invention pertains to a training method for training an artificial intelligence system to be used in such a method. Moreover, the invention pertains to a system for generating a digitally stained image (51′) of a biological tissue probe (50) and/or for training an artificial intelligence system. The system comprises a processing unit for performing at least one of said methods. Furthermore, the invention relates to a non-transitory storage medium containing instructions that, when executed by a computer, causes the computer to perform said methods.