Camera Pixel Array Fusion for Dark Environment Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional camera systems with Bayer color filter arrays filter out most light, affecting image quality, especially in dark environments due to their limited spectral response.
Innovation Solution
A camera assembly with a pixel array comprising sub-units of transparent and color photosensitive pixels, where the color photosensitive pixel has a narrower spectral response range than the transparent pixel, allowing for the acquisition of a first color original image and a second color original image, which are then fused to improve signal-to-noise ratio and image clarity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a Bayer color filter array is used, then color image acquisition is enabled, but most light is filtered out reducing signal-to-noise ratio
Solution Approach 1:
The pixel array is divided into multiple sub-units, each containing both color photosensitive pixels and transparent photosensitive pixels. This segmentation allows simultaneous capture of color information (from color pixels) and high-light transmission information (from transparent pixels), resolving the contradiction between light transmission and color accuracy.
Solution Approach 2:
The patent combines color photosensitive pixels and transparent photosensitive pixels within the same sub-unit structure. By merging these two types of pixels and fusing their respective images during processing, the system achieves both high light transmission and accurate color reproduction.
2Adaptability or versatility
If conventional color filter arrays are used, then spectral response is limited, but image quality in dark environments deteriorates
Solution Approach 1:
The patent implements dynamic adaptability by allowing the image processing unit to selectively fuse images from color and transparent pixels based on lighting conditions. In dark environments, the system can rely more on transparent pixels for high signal-to-noise ratio, while in well-lit conditions, color pixels provide accurate color information, thus adapting to different spectral requirements.
Solution Approach 2:
Each sub-unit contains both color photosensitive pixels and transparent photosensitive pixels, making the system multi-functional. The transparent pixels provide broad spectral response for dark environment imaging, while color pixels provide spectral discrimination for color imaging, enabling the system to handle multiple imaging scenarios simultaneously.
3Measurement precision
If transparent photosensitive pixels are used, then signal-to-noise ratio improves, but color information is lost
Solution Approach 1:
The image processing unit merges the grayscale image from transparent pixels (providing high signal-to-noise ratio) with the color image from color pixels (providing color information). This merging process, such as weighted fusion or multi-scale fusion, preserves both the high quality luminance information and the color information in the final output image.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The fusion of images from transparent and color photosensitive pixels enhances image quality in dark environments by improving signal-to-noise ratio and clarity, resulting in better image acquisition.
Implementation Method 1
A first color original image and a second color original image are acquired by exposing the pixel array... each of the multiple pieces of first color original image data is generated by the at least one color photosensitive pixel... each of the multiple pieces of second color original image data is generated by the at least one transparent photosensitive pixel and the at least one color photosensitive pixel
Data Source
AI summary
An image acquisition method, a camera assembly, and a mobile terminal are provided. The image acquisition method includes: acquiring a first color original image and a second color original image by exposing the pixel array, each piece of first color original image data in the first color original image being generated by at least one color photosensitive pixel in a sub-unit, and each piece of second color original image data in the second color original image being generated by at least one transparent photosensitive pixel and at least one color photosensitive pixel in the sub-unit; and fusing the first color original image and the second color original image to acquire a target image.