Imaging System for Simultaneous Full-Color and NIR Acquisition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional endoscopic imaging systems face challenges in simultaneously acquiring high-quality full-color visible light and near-infrared (NIR) images without compromising image resolution or introducing motion artifacts, such as color fringing and 'rainbow effects', due to the need for multiple sensors or sequential illumination.
Innovation Solution
A system and method that continuously illuminates an area under observation with blue/green light and periodically switches on and off red or NIR light, using one or more sensors to detect blue, green, and combined red/NIR light, allowing for simultaneous acquisition of full-color and NIR images by separating the spectral components in synchronism with the illumination, and employing a three-sensor camera for time-multiplexing and interpolation to maintain high image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If separate sensors are used for full-color and NIR imaging, then both imaging modes can be acquired simultaneously, but the number of image sensors increases and image resolution is compromised
Solution Approach 1:
The patent segments the sensor's photodetector array into different functional regions: some pixels detect visible light (RGB channels) while others detect NIR light. This spatial segmentation allows simultaneous full-color and NIR imaging using a single sensor device, avoiding the need for multiple separate sensors while maintaining imaging capability for both modes.
Solution Approach 2:
The patent implements a universal image sensor that performs multiple functions: it simultaneously captures full-color visible light images and NIR images using the same sensor device. The sensor's photodetectors are designed to respond to both visible and NIR spectral ranges, eliminating the need for separate dedicated sensors for each imaging mode.
2Device complexity
If sequential illumination is used for visible and NIR light, then a single sensor can be used, but motion artifacts such as color fringing and rainbow effects occur
Solution Approach 1:
The patent employs continuous illumination with visible light (blue, green, red) while periodically modulating NIR illumination. The sensor continuously captures visible light signals and simultaneously captures NIR signals during the periodic NIR illumination phases. This continuous acquisition approach ensures that both full-color and NIR images are captured at the same moment, eliminating temporal delays that cause motion artifacts like color fringing and rainbow effects.
3Reliability
If high frame rate is increased to reduce motion artifacts, then image quality improves, but data transfer rate requirements become difficult to implement for high definition images
Solution Approach 1:
The patent uses periodic modulation of NIR illumination synchronized with the sensor's readout cycle. Instead of requiring continuous high-speed data transfer for all pixels at all times, the system periodically activates NIR illumination and synchronizes sensor readout to capture NIR signals during these periodic windows. This allows high-definition NIR and full-color images to be acquired simultaneously at video rates without overwhelming data transfer requirements, as the sensor efficiently multiplexes between visible and NIR signal capture.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the simultaneous acquisition and display of high-quality full-color and NIR images at video rates without compromising image resolution or introducing objectionable motion artifacts, providing continuous luma information and sufficient chroma for accurate video imaging of living tissue.
Implementation Method 1
The blue, green, red and NIR light returning from the area under observation is directed to one or more sensors which are configured to separately detect the blue light, the green light, and the combined red light /NIR light
Implementation Method 2
The red light spectral component and the NIR light spectral component are determined separately from image signals of the combined red light /NIR light, in synchronism with the switched red and NIR light
Data Source
Figure 1
Figure 2a~2b
Figure 2c~2d
AI summary
An imaging system for acquisition of NIR and full-color images includes a light source providing visible light and NIR light to an area under observation, such as living tissue, a camera having one or more image sensors configured to separately detect blue reflectance light, green reflectance light, and combined red reflectance light /detected NIR light returned from the area under observation. A controller in signal communication with the light source and the camera is configured to control the light source to continuously illuminate area under observation with temporally continuous blue/green illumination light and with red illumination light and NIR excitation light. At least one of the red illumination light and NIR excitation light are switched on and off periodically in synchronism with the acquisition of red and NIR light images in the camera.