Composite Image Pickup Apparatus for Surgical Fluorescence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image pickup apparatuses are not suitable for capturing composite visible-light and infrared images during surgeries due to space constraints and the need for flexible imaging configurations, as they often require complex setups like dichroic mirrors that obstruct the surgical site.

Innovation Solution

An image pickup apparatus comprising a light source for visible and infrared light, an optical filter that transmits infrared fluorescence while blocking excitation light, and a solid-state image sensor capable of capturing both visible and infrared images, with a signal processing circuit to generate a composite image signal, allowing for flexible positioning and reduced device size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a dichroic mirror is used to reflect excitation light and transmit fluorescence to maximize visible light transmission (50% reflectance, 50% transmittance), then the visible light reaching the image sensor is maximized, but the intensity of visible light reaching the sensor is only 25% of what could be obtained without the dichroic mirror

Engineering Contradiction:
Improvecapability to capture both visible-light and infrared imagesVSAvoidintensity of visible light reaching the image sensor
Core Design Contradiction:
Adaptability or versatilityVSIllumination intensity

Solution Approach 1:

The patent separates the imaging system into two independent optical paths: one for visible light imaging and another for infrared fluorescence imaging. By using separate image sensors (first image sensor for visible light, second image sensor for infrared), the system captures both types of images without requiring a dichroic mirror that would attenuate visible light. This segmentation eliminates the 25% intensity loss while maintaining the capability to capture both visible and infrared images simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs a solid-state image sensor that is sensitive to both visible light and near-infrared light, allowing a single sensor type to perform multiple functions. By controlling the illumination sources (visible light source and infrared excitation source) and using appropriate optical filters, the same sensor captures both visible-light images and infrared fluorescence images, eliminating the need for complex optical path separation and avoiding visible light attenuation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If a microscope instrumentation with dichroic mirror is used to observe both visible-light and infrared images, then composite imaging capability is achieved, but the device complexity increases and it is difficult to apply to surgical observation where space must be maintained

Engineering Contradiction:
Improvecomposite imaging capabilityVSAvoidcomplexity of optical path arrangement
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the imaging system into separate visible light imaging path and infrared fluorescence imaging path, using independent image sensors for each. This segmentation eliminates the need for complex optical components like dichroic mirrors and beam splitters, significantly simplifying the overall device structure while maintaining composite imaging capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces the complex mechanical optical path arrangement with a simpler electronic control system. By using a solid-state image sensor sensitive to both visible and infrared wavelengths, and controlling the illumination sources and optical filters electronically, the system achieves composite imaging without the mechanical complexity of traditional microscope instrumentation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If an image pickup apparatus with constituent elements near the object is used, then imaging capability is achieved, but it obstructs the surgical operation and makes it difficult to maintain necessary space for surgical maneuvering

Engineering Contradiction:
Improveimaging qualityVSAvoidspace for surgical maneuvering
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent combines the visible light imaging and infrared fluorescence imaging functions into a single integrated apparatus with a unified control system. This merging allows the device to be more compact and flexible in positioning, enabling it to maintain necessary distance from the surgical site while still providing high-quality composite imaging through the coordinated operation of multiple image sensors and processing circuits.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the capture of high-quality composite images with adjustable balance between visible-light and infrared image intensities, reducing device size and obstruction, while maintaining high sensitivity and convenience for surgical applications.

Implementation Method 1

an infrared image from an infrared fluorescent substance... an optical filter for transmitting the infrared fluorescent light

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 2

an optical filter for transmitting the infrared fluorescent light and a spectral component that corresponds to the first-component light among light from the subject, and preventing transmission of a spectral component that corresponds to the second-component light

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Implementation Method 3

a solid-state image sensor capable of capturing a visible-light image and an infrared image on the basis of transmitted light of the optical filter

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS7538309B2Image pickup apparatus
Publication Date: 2009.05.26 SEMICON COMPONENTS IND LLC
  • US7538309B2 patent drawing
  • US7538309B2 patent drawing
  • US7538309B2 patent drawing

AI summary

An image pickup apparatus capable of capturing a composite image of a visible-light image and an infrared image of a subject is provided, whereby the configuration is simplified and made more convenient. A visible-light source (20) and an excitation-light source (22) for exciting a phosphorescent substance are provided as a light source (6) for a subject that includes an infrared-fluorescent substance. The light from the subject is passed through an optical filter (10) and directed into a CCD image sensor (12). The optical filter (10) cuts excitation light and transmits fluorescent light. The transmittance of visible light by the optical filter (10) is set lower than the transmittance of fluorescent light so that the weak infrared image from the fluorescent light is clearly displayed over the visible-light image. Since the CCD image sensor (12) is sensitive to infrared light as well as to visible light, an image signal is outputted for the composite image according to the incident light from the optical filter (10).