Multi-Sensor Surgical Camera for Concurrent NIR-Color Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing minimally invasive surgical systems face challenges in simultaneously displaying near-infrared (NIR) fluorescence images and visible-range images without degrading spatial resolution or requiring time-consuming mode switching, which hinders real-time visualization of fluorescence during surgeries.
Innovation Solution
A method and system that utilizes a multi-sensor camera with sensors configured to capture visible and NIR light, predicting missing color channels based on correlated sensor data, allowing concurrent display of NIR fluorescence on an approximate full-color image, thereby enabling real-time visualization without separate NIR sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If separate NIR sensors and visible-range sensors are used, then NIR fluorescence detection capability is improved, but device complexity increases
Solution Approach 1:
The visible-range sensor is made multi-functional by enabling it to detect both visible light for color imaging and NIR fluorescence through appropriate filtering and signal processing. This allows a single sensor to perform multiple functions that would traditionally require separate sensors, thereby reducing device complexity while maintaining NIR detection capability
Solution Approach 2:
The patent combines the visible-range imaging function and NIR fluorescence detection function into a single integrated sensor system. By merging these functions into one sensor rather than using separate sensors, the overall device complexity is reduced while maintaining both imaging capabilities
2Measurement precision
If mode switching between visible and NIR imaging is implemented, then specialized imaging capability is improved, but loss of time increases
Solution Approach 1:
The system enables continuous simultaneous capture of both visible-range and NIR fluorescence images by the same sensor without requiring mode switching. This continuous operation eliminates the time loss associated with switching between imaging modes while maintaining specialized imaging capabilities for both visible and NIR ranges
3Device complexity
If a single sensor captures both visible and NIR light, then device complexity is reduced, but measurement precision deteriorates
Solution Approach 1:
The sensor output is segmented into different wavelength components using optical filters. The visible light signal and NIR fluorescence signal are separated through filtering, allowing each to be processed independently with appropriate precision while using the same physical sensor, thus maintaining spatial resolution despite using a single sensor
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables real-time visualization of NIR fluorescence on a full-color image, improving surgical precision by eliminating the need for mode switching and maintaining spatial resolution.
Implementation Method 1
a third sensor configured to capture the surgical scene as illuminated by a near-infrared (NIR) light source
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
The technology described herein can be embodied in a method that includes receiving data representing information captured using a first sensor and a second sensor of a multi-sensor camera. The sensors are configured to capture a surgical scene illuminated by a light source configured to emit wavelengths in the visible spectrum corresponding to sensing capabilities of the first and second sensors, respectively. The method also includes receiving data representing information captured using a third sensor of the multi-sensor camera, the third sensor configured to capture the surgical scene as illuminated by a near-infrared light source, and generating a first visual representation of the surgical scene based on the data representing the information captured using the first and second sensors. The first visual representation is combined with the information captured using the third sensor to generate a second visual representation, and the second visual representation is presented on a display device.