Single Plate Imaging Device Noise Reduction Using Infrared Edge Information
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing methods for solid state imaging devices with single plate color systems struggle to reduce noise effectively in a single shot image, especially in general digital cameras and video cameras, which cannot photograph multiple images with different spectra.
Innovation Solution
An image signal processing apparatus and method that includes a demosaic processing unit and a noise reduction processing unit, utilizing a color array with RGB elements and A elements that capture visible and invisible light components, including infrared, to generate demosaic images and correct pixel values based on edge information from the A signal, allowing noise reduction in a single photographed image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple images with different spectra are photographed to reduce noise, then noise reduction effectiveness is improved, but the applicability to general digital cameras and video cameras deteriorates because they cannot photograph multiple images
Solution Approach 1:
The patent segments the spectral information capture into two distinct element types within the same imaging device: visible light obtaining elements (RGB) and invisible light obtaining elements (A signal including infrared). By dividing the spectral capture function across different pixel types rather than requiring multiple separate photographs, the system achieves noise reduction capability in general digital cameras and video cameras that capture only single images.
2Loss of information
If a color filter with Bayer color array is used to capture RGB color components, then color information is obtained, but noise reduction capability deteriorates because only single color component data is available at each pixel
Solution Approach 1:
The patent merges the functionality of multiple spectral sensors into a single imaging device by combining visible light obtaining elements (RGB color filters) and invisible light obtaining elements (A signal filters) in the same color array. This merging allows the system to simultaneously capture both visible color information and invisible light information at different pixel locations, enabling noise reduction through spectral differencing without requiring multiple separate photographs.
3Loss of information
If demosaic processing is performed to restore color components in each pixel, then complete color information is achieved, but image quality deteriorates due to noise in the restored components
Solution Approach 1:
The patent introduces invisible light information (A signal) as an intermediary to improve the quality of visible light demosaic processing. The A signal elements, which capture infrared and other invisible wavelengths, provide additional spectral information that serves as a mediator to guide and constrain the demosaic reconstruction of RGB color components. This intermediary spectral information helps distinguish between actual image features and noise, resulting in higher quality demosaic output with reduced noise artifacts.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables effective noise reduction and improved image quality in single shot images, applicable to general digital still cameras and video cameras, by using edge information from the A signal to correct pixel values in the RGB demosaic image, resulting in images with accurate colors and reduced noise.
Implementation Method 1
A solid state imaging device 13 of the single plate color system receives the light that transmits a color filter 12 among the incident light through an optical lens 11. An image signal that is photoelectrically converted by the solid state imaging device 13 to be output as an electric signal
Data Source
AI summary
There is provided an image signal processing apparatus, comprising a demosaic processing unit receiving input of mosaic image data of each of signals obtained by a single plate imaging device having an element array composed of visible light obtaining elements obtaining visible light signals, and invisible light obtaining elements obtaining signals including invisible light components, and generating a demosaic image of each of the obtained signals; and a noise reduction processing unit receiving input of the demosaic image to execute correction of pixel values of the demosaic image obtained by the visible light obtaining elements on the basis of edge information extracted from the demosaic image of the signals obtained by the invisible light obtaining elements.