Fluorescent Imaging Device Tracking via Multi-Wavelength Separation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Fluorescent imaging devices face challenges in performing moving-body tracking with high accuracy during surgical operations due to issues like insufficient fluorescence intensity and interference from surgical lamps, which affect the detection of observation sites.

Innovation Solution

A fluorescent imaging device equipped with a light source unit that includes excitation light, visible illumination light, and non-visible light sources, along with an imager and tracking processor, which captures fluorescent, visible, and non-visible images using an optical filter to separate light wavelengths and perform moving-body tracking based on these images, allowing for accurate detection without the need for fluorescent agent administration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If moving-body tracking processing is performed using the fluorescent image, then tracking can be performed after fluorescent agent administration, but the observation site cannot be detected unless the fluorescent agent has flowed into the observation site such that the fluorescence intensity sufficiently rises

Engineering Contradiction:
Improvetracking accuracyVSAvoidtime delay before tracking
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by capturing and storing a pre-operative image before fluorescent agent administration. This pre-operative image serves as a reference for subsequent tracking operations, enabling the system to identify the observation site immediately without waiting for fluorescent agent accumulation. The pre-captured image contains anatomical landmarks and structural information that can be used for initial localization and tracking initialization.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary approach by using a pre-operative image as a mediator between the surgical field and the tracking system. This intermediary image bridges the gap before fluorescent signal is available, providing a reference framework that enables immediate tracking. The pre-operative image acts as a substitute reference when the fluorescent signal is not yet sufficient for tracking.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If moving-body tracking processing is performed using a reflected image of visible light, then tracking can be performed immediately, but high-luminance luminescent spots occur due to the reflected light of surgical lamps

Engineering Contradiction:
Improvetracking accuracyVSAvoidluminescent spot interference
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system extracts and removes the harmful luminescent spots from the reflected light image through image processing. By identifying and eliminating these high-luminance artifacts caused by surgical lamp reflection, the system recovers the underlying anatomical structures and observation site features, enabling accurate tracking without interference from spurious light sources.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent converts the harmful effect of surgical lamp reflection into a beneficial signal by using the reflected light image as a primary reference. Instead of discarding the reflected light image due to luminescent spots, the system processes it to extract useful anatomical information. The reflected light, while containing artifacts, provides immediate structural information that can be cleaned and utilized for tracking initialization and ongoing reference.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Adaptability or versatility

If a single imaging system is used, then device complexity is reduced, but it cannot capture fluorescent images, visible images, and non-visible images simultaneously

Engineering Contradiction:
Improvemulti-wavelength imaging capabilityVSAvoidimaging system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The imaging system is segmented into multiple specialized imaging channels: a fluorescent imaging channel, a visible light reflected image channel, and a non-visible light channel. Each channel is optimized for its specific wavelength range and imaging modality. This segmentation allows simultaneous capture of different image types without cross-interference, as each channel processes specific wavelength ranges independently through dedicated optical paths and sensors.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system achieves multi-functionality by integrating multiple imaging capabilities into a single unified platform. The imaging device can simultaneously perform fluorescent imaging, visible light imaging, and non-visible light imaging, providing comprehensive surgical guidance. This multi-functional design allows the system to adapt to different surgical needs and stages (before and after fluorescent agent administration) without requiring separate devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The device achieves high-accuracy moving-body tracking by reducing luminescent spot interference and enabling tracking before and after fluorescent agent administration, with improved image quality and reduced radiation exposure.

Implementation Method 1

an imager including an optical filter, the optical filter being configured to separate light in the visible wavelength range from both fluorescence outside the visible wavelength range excited by the excitation light and the non-visible light

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Implementation Method 2

a first light source for radiating excitation light for a fluorescent agent administered to a subject

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Data Source

PatentUS11439468B2Fluorescent imaging device
Publication Date: 2022.09.13 SHIMADZU CORP
  • US11439468B2 patent drawing
  • US11439468B2 patent drawing
  • US11439468B2 patent drawing

AI summary

A fluorescent imaging device includes a light source unit including a first light source for radiating excitation light, a second light source for radiating visible illumination light, and a third light source for radiating non-visible light, an imager being configured to capture a fluorescent image, a visible image, and a non-visible image, and a tracking processor that is operable to perform moving-body tracking for a region of interest that is set in an image based on at least the non-visible image.