Demosaicing Using Dual Camera Luminance Chrominance Separation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current demosaicing methods using single-camera systems with Bayer color filter arrays result in reduced image resolution due to incomplete luminance information and aliasing, leading to blurred textures and moiré effects in high-frequency regions.
Innovation Solution
A demosaicing method and apparatus utilizing a dual-camera system with a color camera and a monochrome camera, where the monochrome camera provides more accurate luminance information to guide the demosaicing process, allowing for the extraction of true chrominance and luminance signals, thereby improving image resolution and reducing aliasing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single-camera system with Bayer color filter array is used, then the device complexity is reduced, but the image resolution deteriorates due to incomplete luminance information and aliasing
Solution Approach 1:
The imaging system is segmented into two specialized cameras: a color camera for capturing chrominance information and a monochrome camera for capturing high-quality luminance information. This segmentation allows each camera to be optimized for its specific function, resolving the contradiction between device complexity and image resolution by distributing functionality across multiple specialized components rather than requiring a single complex camera to handle all tasks
Solution Approach 2:
The patent merges the outputs of two separate camera systems (color and monochrome) through a demosaicing process that combines chrominance data from the color camera with luminance data from the monochrome camera. This merging creates a composite image that achieves high resolution without requiring a single overly complex camera system, thus resolving the technical contradiction
2Device complexity
If simple interpolation is used for demosaicing, then the device complexity is reduced, but the measurement precision deteriorates due to moire and blurred textures in high-frequency regions
Solution Approach 1:
The monochrome camera acts as an intermediary that provides accurate luminance information to guide the demosaicing process. Instead of relying solely on simple interpolation of color channel data, the system uses the high-quality luminance signal from the monochrome camera as a mediator to reconstruct the full-color image, thereby improving measurement precision without significantly increasing processing complexity
Solution Approach 2:
The patent changes the approach from interpolating color channel values to using luminance-guided reconstruction. By transforming the problem from direct color interpolation to luminance-based reconstruction with chrominance overlay, the system achieves higher measurement precision while keeping processing complexity manageable through the use of established demosaicing algorithms enhanced by the luminance guide
Data Source
Figure 1~2
Figure 3A
Figure 3B
AI summary
This application provides a demosaicing method and apparatus, to resolve a problem that image resolution is reduced. The method is applied to an electronic device including a color camera and a monochrome camera, and the color camera and the monochrome camera are disposed in parallel in the electronic device. The method includes: obtaining a to-be-processed color image obtained after the color camera photographs a target scenario, and extracting a first luminance component of the to-be-processed color image; obtaining a monochrome image obtained after the monochrome camera collects the target scenario at the same moment, and extracting a second luminance component of the monochrome image; performing registration on the first luminance component and the second luminance component by using a preset algorithm, to generate a third luminance component; extracting a chrominance component of the to-be-processed color image based on the third luminance component; and compositing a color output image based on the extracted chrominance component of the to-be-processed color image and the third luminance component.