Electronic Microscope Hyperspectral Imaging via Cyclic Illumination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Electronic microscopes face challenges in enhancing visual representation capability while balancing spectral channels, illumination spectra, spatial and temporal resolution, and brightness sensitivity, particularly in medical interventions where subjective and objective object properties need to be considered.

Innovation Solution

The electronic microscope employs multiple spectral channels in the image sensor and a variable illumination device to generate primary image data sets, which are processed to calculate a reflection spectrum, allowing for the creation of secondary image data sets that can be modified to enhance information content and visibility, using a computing rule that accounts for different reception and illumination spectra.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple spectral channels and illumination spectra are used to increase information content, then the representation capability is improved, but the device complexity and illumination requirements increase

Engineering Contradiction:
Improveinformation contentVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system uses periodic action by cyclically switching between multiple illumination spectra (e.g., red, green, blue LED wavelengths) over time. The illumination device alternates between different spectral outputs in a repeating cycle, allowing the image sensor to capture multiple spectral channels sequentially. This periodic illumination approach enables hyperspectral information acquisition without requiring all spectra to be present simultaneously, thus managing device complexity while increasing information content.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system applies dynamics by making the illumination spectrum variable and adjustable. The control device dynamically switches between different illumination spectra based on operational requirements. This dynamic capability allows the microscope to adapt the illumination characteristics to specific imaging needs, enabling flexible information acquisition across different spectral ranges without being constrained to a fixed spectral configuration.

Inventive Principle:
Principle #15Dynamics

2Loss of information

If multiple spectral channels are provided to increase information content, then the representation capability is improved, but the illumination requirements and heating of the object increase

Engineering Contradiction:
Improveinformation contentVSAvoidheating of the object
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The periodic switching between different illumination spectra allows the system to distribute the illumination duty cycle across multiple wavelengths. Instead of continuously illuminating with high intensity across all spectra simultaneously, the system activates each spectral channel in alternating cycles. This temporal distribution reduces the cumulative energy load on the observed object, minimizing heating effects while still capturing comprehensive spectral information over time.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses partial action by selectively activating only the necessary illumination spectra required for the current imaging task rather than continuously providing all spectral channels at full intensity. The control device determines which spectral ranges are needed based on the specific observation requirements, thereby reducing unnecessary illumination exposure and associated heating of the object while maintaining adequate information acquisition.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach improves the visual representation by allowing for increased information content and subjective modification of the image, enabling better differentiation of tissue types and improved surgical visibility, such as distinguishing between oxygen-rich and oxygen-poor blood.

Implementation Method 1

at least one electronic image sensor (12) for generating primary image data sets... The image sensor (12) is configured to generate image signals that correspond to a plurality of different reception spectra

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Implementation Method 2

An illumination device (20) is provided that is configured to transmit electromagnetic radiation having a variable illumination spectrum into the recording zone (16)

Methodology Applied
Scientific EffectElectromagnetic Radiation: Electromagnetic Induction

Implementation Method 3

an imaging optics (14) that serves for generating an image of an object (18) arranged in a recording zone (16) of the microscope (10) on the image sensor (12)

Methodology Applied
Scientific EffectOptical Focusing: Focusing

Data Source

PatentUS10849505B2Electronic microscope
Publication Date: 2020.12.01 ARRI MEDICAL GMBH
  • US10849505B2 patent drawing
  • US10849505B2 patent drawing

AI summary

An electronic microscope has an electronic image sensor for generating primary image data sets, wherein the image sensor is configured to generate image signals that correspond to a plurality of different reception spectra, and wherein each primary image data respectively comprises at least one image signal of each of the plurality of reception spectra for a plurality of image zones. A control device of the microscope is configured to control an illumination device to make a cyclically repeating transmission of electromagnetic radiation having a plurality of different illumination spectra and to control the image sensor to generate a respective primary image data set for each of the plurality of different illumination spectra. A processing unit of the microscope is configured to calculate the reflection spectrum from the generated primary image data sets for at least some of the plurality of image zones and, starting from the primary image data sets generated for the plurality of different illumination spectra, to determine at least one secondary image data set in dependence on the calculated reflection spectrum, said secondary image data set being at least partly modified with respect to the primary image data sets.