Endoscope Color Filter Array with Complementary Pixel Interpolation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Endoscope devices face challenges in achieving high resolution and color accuracy, particularly in dynamic scenes, due to limitations in color separation performance and resolution between sequential and simultaneous lighting modes, and the need for improved image processing in both white light and narrowband light observation modes.
Innovation Solution
An endoscope device with a light source capable of switching between simultaneous and sequential lighting, combined with an image sensor featuring a two-dimensional lattice of pixels and a color filter including primary and complementary filters, performs interpolation processing to generate output images, thereby preventing color shifts and enhancing resolution and color separation in both lighting modes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sequential lighting is used to acquire color information by emitting illumination in different wavelength bands for each frame, then color separation performance and resolution are improved, but color shift occurs in dynamic scenes
Solution Approach 1:
The patent applies dynamics by enabling the light source to switch between sequential lighting and simultaneous lighting modes based on scene requirements. The system dynamically adjusts the lighting mode to maintain color accuracy in dynamic scenes while preserving color separation performance in static scenes, resolving the contradiction between the two lighting approaches.
Solution Approach 2:
The patent changes the lighting mode parameter between sequential and simultaneous lighting. By adjusting this parameter based on scene characteristics, the system optimizes both color separation performance and color accuracy, preventing color shifts in dynamic scenes while maintaining excellent color separation when needed.
2Reliability
If simultaneous lighting is used to acquire color information, then color shift is prevented, but color separation performance and resolution are degraded
Solution Approach 1:
The system dynamically switches between simultaneous lighting (for color accuracy) and sequential lighting (for color separation performance) based on scene requirements. This dynamic adjustment allows the system to maintain color accuracy while improving color separation performance when needed.
Solution Approach 2:
The patent changes the lighting mode parameter between simultaneous and sequential lighting to optimize both color accuracy and color separation performance. By adjusting this parameter, the system resolves the contradiction between preventing color shifts and achieving excellent color separation.
3Adaptability or versatility
If a Bayer array color filter is provided on the image sensor, then color image generation is enabled, but interpolation processing is required which degrades resolution
Solution Approach 1:
The patent applies preliminary action by performing interpolation processing using information from multiple wavelength bands captured by the image sensor. This preliminary processing step reconstructs missing color information more accurately, reducing the resolution degradation typically caused by Bayer array interpolation.
Solution Approach 2:
The patent uses the complementary filter as an intermediary to capture additional wavelength information that aids in more accurate interpolation processing. This intermediary filter provides extra data that improves the quality of color image generation while minimizing resolution loss.
4Device complexity
If only primary color filters (R, G, B) are provided on the image sensor, then simple color image generation is achieved, but resolution of capillary blood vessels and mucosa fine patterns is insufficient
Solution Approach 1:
The patent applies composite materials by combining primary color filters (R, G, B) with a complementary filter (Cy) in the filter array. This composite filter configuration captures both primary color information and additional wavelength information, enabling high-resolution imaging of capillary blood vessels and mucosa fine patterns while maintaining relatively simple device structure.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables the generation of high-quality images without color shifts, achieving excellent resolution and color separation in both simultaneous and sequential lighting modes, even when using an image sensor with mixed primary and complementary pixels.
Implementation Method 1
a light source unit 3 that generates illumination light
Implementation Method 2
each pixel being configured to generate an imaging signal by receiving light and by performing photoelectric conversion
Implementation Method 3
a plurality of filters including at least one type of primary filter and a complementary filter... the at least one type of primary filter being configured to transmit light in any one wavelength band of a red wavelength band, a green wavelength band, and a blue wavelength band
Data Source
AI summary
An endoscope device includes: a light source configured to perform any one of simultaneous lighting and sequential lighting; an image sensor including a plurality of pixels; a plurality of filters including at least one type of primary filter and a complementary filter; and a processor including hardware, the processor being configured to cause the light source to switch between the simultaneous lighting and the sequential lighting, when the simultaneous lighting is performed, perform interpolation processing to generate an output image by using an imaging signal generated from a pixel corresponding to the complementary filter, and when the sequential lighting is performed, perform interpolation processing to generate an output image by using an imaging signal generated from a pixel corresponding to the complementary filter as an imaging signal generated from a pixel corresponding to the at least one type of primary filter.