Hybrid Pixel Array Fusing Panchromatic and Bayer Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile phone cameras equipped with Bayer filter arrays face issues with loss of sharpness after demosaicing, which affects the quality of captured color images.
Innovation Solution
The camera assembly includes a pixel array with both panchromatic and color light-sensitive pixels, where a processor obtains a Bayer image and a panchromatic image, processes them using specific algorithms to generate an RGB image and a luminance image, and then fuses these to produce a YUV image, improving the signal-to-noise ratio and image definition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a Bayer filter array is used to capture color images, then color information can be obtained, but sharpness is lost after demosaicing
Solution Approach 1:
The pixel array is segmented into different subunits, with some subunits containing only color light-sensitive pixels and others containing only panchromatic light-sensitive pixels. This segmentation allows the system to process color and luminance information separately, then combine them to achieve both color fidelity and sharpness without the traditional demosaicing loss.
Solution Approach 2:
Panchromatic light-sensitive pixels serve as an intermediary to provide high-quality luminance information that complements the color information from color light-sensitive pixels. By using panchromatic pixels as a mediator, the system can reconstruct sharp images without relying solely on demosaicing algorithms that degrade sharpness.
2Loss of information
If only color light-sensitive pixels are used, then color images can be captured, but signal-to-noise ratio deteriorates
Solution Approach 1:
The patent merges the advantages of both color light-sensitive pixels and panchromatic light-sensitive pixels by creating a hybrid pixel array. Color pixels provide color information while panchromatic pixels provide high signal-to-noise ratio luminance information. The combination of these two pixel types in different subunits enables simultaneous achievement of color fidelity and high signal quality.
Solution Approach 2:
The pixel array functions as a composite system, combining different types of light-sensitive pixels (color and panchromatic) within the same device. This composite structure allows the system to leverage the complementary strengths of both pixel types, achieving both color capture capability and high signal-to-noise ratio through integrated processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method enhances image quality by improving the signal-to-noise ratio and resulting in higher definition images by effectively processing and fusing Bayer and panchromatic images.
Implementation Method 1
each color light-sensitive pixel has a narrower spectral response than each panchromatic light-sensitive pixel
Implementation Method 2
multiple pixels in the image sensor can receive light passing through corresponding filters to generate pixel signals with different color channels
Data Source
AI summary
An image processing method, a camera assembly and a mobile terminal. The image processing method includes: obtaining a Bayer image and a panchromatic image, obtaining an RGB image after processing the Bayer image with a first processing algorithm and a demosaicing algorithm, obtaining a luminance image after processing the panchromatic image with the first processing algorithm, obtaining a fused RGB image by fusing the RGB image and the luminance image, and obtaining a YUV image after processing the fused RGB image with a second processing algorithm.