Display System Superimposing Fluorescence and Visible Light Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In medical and other applications, existing display systems struggle to facilitate the adjustment of display images based on captured images, particularly in environments where weak fluorescence is difficult to visualize, such as during surgeries, due to the challenge of identifying regions emitting fluorescence in invisible wavelength bands.

Innovation Solution

A display system that superimposes the capture image and the display image, allowing for real-time adjustment by projecting a visible light image onto the surgical field to visualize regions emitting fluorescence, and enabling the user to adjust settings like threshold values and gradations directly on a monitor display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If fluorescence imaging is used to visualize regions emitting fluorescence in invisible wavelength bands, then measurement precision is improved, but ease of operation deteriorates due to difficulty in adjusting display images

Engineering Contradiction:
Improvevisualization accuracy of fluorescence regionsVSAvoidadjustment difficulty of display image
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent creates a visible light copy image that corresponds to the fluorescence image captured in invisible wavelength bands. This copy image is generated by capturing visible light from the same region and superimposing it with the fluorescence image. The visible light copy serves as a reference that makes adjustment intuitive, allowing operators to easily adjust threshold values and other parameters by comparing the superimposed images without needing to interpret invisible wavelength data directly.

Inventive Principle:
Principle #26Copying

2Measurement precision

If threshold value adjustment is performed to extract fluorescence regions, then measurement precision is improved, but loss of information increases during the binarization process

Engineering Contradiction:
Improvefluorescence region extraction accuracyVSAvoidinformation loss in binarized image
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent performs preliminary capture of a visible light copy image before binarization of the fluorescence image. This visible light copy is stored and later superimposed on the binarized fluorescence image. By preparing the visible light reference in advance, the system preserves information about the original region appearance that would otherwise be lost during threshold-based binarization, allowing operators to verify that extracted fluorescence regions correspond to actual anatomical structures.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If real-time fluorescence observation is implemented, then productivity is improved, but device complexity increases due to multiple imaging systems

Engineering Contradiction:
Improvereal-time observation capabilityVSAvoidsystem configuration complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges the fluorescence imaging system and visible light imaging system into a single integrated device. Both imaging functions share common components including the imaging device, control unit, and display unit. The control unit coordinates both imaging modes and performs superimposition processing, eliminating the need for separate standalone systems. This integration achieves real-time fluorescence observation capability while reducing overall system complexity through shared hardware resources.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This system enhances the visualization of fluorescence-emitting regions during surgeries by allowing for real-time adjustment of projection images based on captured fluorescence images, improving the accuracy and efficiency of surgical procedures by simplifying the comparison and adjustment process.

Implementation Method 1

an imaging device, which captures a fluorescence image based on fluorescence light emitted from a photosensitive substance in an object when excited by light

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 2

an imaging device, which captures a fluorescence image based on fluorescence light emitted... and converts the fluorescence image into image data

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentEP3506624B1Display system
Publication Date: 2022.12.21 PANASONIC HOLDINGS CORP
  • EP3506624B1 patent drawingFigure 1
  • EP3506624B1 patent drawingFigure 2
  • EP3506624B1 patent drawingFigure 3

AI summary

A display system (100) includes an irradiator (230), an imager (210), an image generator (250), a display (220), and an adjuster (170). The irradiator irradiates an object with light having a predetermined wavelength. The imager captures an image based on light excited by the light having the predetermined wavelength. The image generator generates a display image (6) based on a capture image (5) captured by the imager. The display displays the display image. The adjuster adjusts the display image on the basis of a user operation. The display displays a superimposed image (7) in which the display image and the capture image are superimposed with each other, upon adjustment of the display image by the adjuster.