Single Camera Multicolor Medical Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current medical imaging techniques require two cameras and separate systems for capturing white light and fluorescent light images simultaneously, leading to increased equipment and computational demands, as well as the need for filter changes, which can be technologically challenging, especially at the distal end of an endoscope.

Innovation Solution

A method and device using a single multicolored image sensor or camera system with dichroic separation and adapted filter design to differentiate between fluorescent and white light, reconstructing the missing color channel information based on statistical correlations, allowing for simultaneous capture of both images without filter changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If two cameras are used to capture white light and fluorescent light images simultaneously, then both images can be captured at the same time, but the equipment requirements and computational demands are doubled

Engineering Contradiction:
Improvesimultaneous image capture capabilityVSAvoidequipment requirements
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The single camera's image sensor is segmented into multiple color channels (e.g., red, green, blue) that can be selectively activated. By dividing the spectral detection into separate channels, the system can capture both white light and fluorescent light images simultaneously using one camera instead of two, reducing equipment complexity while maintaining simultaneous capture capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A single camera system is designed to perform multiple functions by capturing both white light images and fluorescent light images through its color channels. The camera serves as a universal device that can operate in different modes (white light mode, fluorescent light mode, or combined mode) without requiring separate dedicated cameras for each function

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If a single camera system is used to capture both white light and fluorescent light images, then equipment requirements are reduced, but filter changes are required when switching between modes

Engineering Contradiction:
Improveequipment requirementsVSAvoidfilter changing requirement
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The observation filter is made dynamically switchable between different spectral ranges (white light range and fluorescent light range). Instead of requiring manual filter changes, the filter can be electronically adjusted to match the illumination mode, enabling seamless switching between white light and fluorescent light capture modes without operational interruptions

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The optical parameters of the observation filter are changed to match the illumination characteristics. When switching from white light illumination to fluorescent light illumination, the filter's spectral transmission characteristics are adjusted accordingly, allowing the single camera to adapt to different imaging modes without physical filter replacement

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If the color channel used for fluorescent light detection is lost, then fluorescent light can be captured, but the white light color information is incomplete

Engineering Contradiction:
Improvefluorescent light detection accuracyVSAvoidwhite light color information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The lost color channel information is reconstructed by copying and synthesizing data from the remaining color channels. Using the relationships between color channels and the known illumination spectrum, the system generates a virtual copy of the missing color channel data, allowing reconstruction of the complete white light image with accurate color information while maintaining fluorescent light detection capability

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Reduces equipment and computational requirements, enabling simultaneous capture of white light and fluorescent light images with natural coloring, reducing fatigue for medical personnel and improving focus on relevant information.

Implementation Method 1

an image of the medical object in fluorescent light are acquired simultaneously or sequentially

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 2

when observing fluorescence light, a filter is generally required that blocks the reflected portions of the light used to excite the fluorescence

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Implementation Method 3

Both cameras can be coupled to a single endoscope or lens, for example via dichroic mirrors, in order to capture both images from the same perspective

Methodology Applied
Scientific EffectDichroic separation: Dichroic Filter

Data Source

PatentEP2263516B1Method and device for controlling a multi-colour display of an image from a medical object
Publication Date: 2015.10.07 KARL STORZ SE & CO KG
  • EP2263516B1 patent drawingFigure 1~5
  • EP2263516B1 patent drawingFigure 3~4
  • EP2263516B1 patent drawingFigure 6~7

AI summary

In a method for controlling a multicolor output of an image of a medical object (10) to assist medical personnel, the medical object (10) is illuminated with light with an illumination spectrum. Image data for a group of one or more color channels is acquired by means of an image sensor (53). Image information relating to a further color channel, which is not part of the group of one or more color channels, is generated depending on the acquired image data. An image output device (79) for multicolor output of the image depending on the acquired image data and the generated image information is controlled.