Virtual Transmitted-Light Image Generation from Fluorescent Microscopy

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Transmitted-light observation is not suitable for thick specimens, as it results in light attenuation, limiting the diagnostic capabilities in pathological diagnosis, whereas fluorescence observation can handle thicker specimens but lacks compatibility with traditional transmitted-light imaging.

Innovation Solution

An image processing device and system that estimates the fluorescence emission of fluorescent dyes, calculates tissue amounts, and generates a virtual transmitted-light image from fluorescent images captured using a fluorescent microscope, allowing for the conversion of fluorescent images into virtual transmitted-light images compatible with bright-field dye groups.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If transmitted-light observation is used, then compatibility with traditional bright-field imaging is maintained, but observation of thick specimens is limited due to light attenuation

Engineering Contradiction:

Improvecompatibility with traditional bright-field imagingVSAvoidobservation capability for thick specimens

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces image processing as an intermediary that converts fluorescent images into virtual transmitted-light images. This mediator enables the bridge between fluorescence observation (suitable for thick specimens) and transmitted-light observation (traditional bright-field compatibility), allowing pathologists to observe thick specimens with familiar imaging characteristics.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter domain by transforming image data from fluorescence intensity space to transmitted-light intensity space through computational processing. This parameter transformation allows the same specimen data to be interpreted in two different imaging modalities, resolving the contradiction between observation depth and imaging compatibility.

Inventive Principle:

Principle #35Parameter changes

2Reliability

If fluorescence observation is used, then observation of thick specimens is enabled, but compatibility with traditional transmitted-light imaging is lost

Engineering Contradiction:

Improveobservation capability for thick specimensVSAvoidcompatibility with traditional transmitted-light imaging

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent creates a virtual copy of the transmitted-light image from the fluorescent image data. Instead of requiring actual transmitted-light microscopy for thick specimens, the system generates a computational copy that mimics the appearance and characteristics of transmitted-light imaging, maintaining pathologist familiarity while enabling thick specimen observation.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

Image processing serves as the intermediary that translates fluorescent image data into the visual language of transmitted-light images. This translation layer preserves the advantages of fluorescence observation for thick specimens while restoring compatibility with traditional bright-field imaging conventions.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Reliability

If image processing is applied to convert fluorescent images to virtual transmitted-light images, then diagnostic capability for thick specimens is enhanced, but processing complexity increases

Engineering Contradiction:

Improvediagnostic capability for thick specimensVSAvoidimage processing complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces complex mechanical or chemical processing with computational image processing. Instead of physically transforming the specimen or using complex multi-step staining procedures, the system uses software-based transformation to achieve the same diagnostic goal, reducing physical complexity while enhancing diagnostic capability.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of highly accurate virtual transmitted-light images from fluorescent images, facilitating pathologist observation and reducing the load on pathologists by enhancing diagnostic capabilities for thick specimens.

Implementation Method 1

a fluorescent image obtained by capturing a tissue group including one or more tissues dyed by using a fluorescent dye group including one or more fluorescent dyes by a fluorescent microscope

Methodology Applied

Scientific EffectFluorescence: Fluorescence

Data Source

PatentUS11378515B2Image processing device, imaging system, actuation method of image processing device, and computer-readable recording medium

Publication Date: 2022.07.05 EVIDENT CORP

AI summary

An image processing device includes: a processor including hardware. The processor is configured to: with respect to each pixel included in a fluorescent image obtained by capturing a tissue group including one or more tissues dyed by using a fluorescent dye group including one or more fluorescent dyes by a fluorescent microscope, estimate a light quantity of fluorescence emitted by each fluorescent dye of the fluorescent dye group; estimate a tissue amount of each tissue of the tissue group based on the estimated light quantity; estimate a virtual dye amount of each dye of a bright-field dye group of a case in which the tissue group dyed by using the bright-field dye group including one or more dyes is captured by a transmission-type microscope based on the estimated tissue amount; and generate a virtual transmitted-light image from the estimated dye amount.