Luminance-Guided Upsampling for High-Resolution Image Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High-resolution image sensors face challenges in achieving fast readout and low noise while maintaining resolution, as reading out individual pixel values in every frame consumes excessive power and time, and conventional pixel binning techniques decrease image resolution.
Innovation Solution
Implementing a red-green-blue-luminance (RGBL) color filter array pattern with at least 50% luminance pixels, using pixel binning to generate downsampled RGB and L capture frames, and then upsampling the L frame to guide luminance-interpolated RGB frame restoration to achieve high-resolution output.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If pixel binning is used to reduce readout time and power consumption, then readout efficiency improves, but image resolution decreases
Solution Approach 1:
The patent segments the pixel array into different functional groups (luminance pixels and color pixels) that are read out separately through different readout paths. Luminance pixels are binned and read out efficiently for high-speed low-power operation, while color pixels maintain individual readout capability for high-resolution color information, resolving the contradiction between readout efficiency and image resolution
Solution Approach 2:
The patent introduces an intermediary processing stage where luminance information from binned pixels serves as a guide for reconstructing high-resolution color images. The luminance data acts as a mediator that enables resolution recovery without requiring full readout of all color pixels, thus maintaining both readout efficiency and image resolution
2Reliability
If higher power is provided to the readout chain, then read noise decreases and dynamic range improves, but power consumption increases
Solution Approach 1:
The patent applies different quality levels to different pixel types: luminance pixels use high-power readout paths optimized for low noise and high dynamic range, while color pixels use lower-power readout paths. This local differentiation allows the system to achieve high image quality where most critical (in luminance) without uniformly high power consumption across all pixels
Solution Approach 2:
The patent applies excessive action (high-power readout) only to the extent necessary for luminance pixels which contribute most to perceived image quality, while using partial action (lower-power readout) for color pixels. Since luminance information carries the majority of visual information, this partial application of high power achieves high image quality with reduced overall power consumption
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables efficient high-resolution image capture with reduced power consumption and noise, maintaining or exceeding native sensor resolution without the computational intensity of conventional methods.
Implementation Method 1
The basic function of a modern CMOS image sensor (CIS) is to capture photons that are converted into electrons in a photodiode
Data Source
AI summary
Techniques are described for efficient high-resolution output of an image captured using a high-pixel-count image sensor based on pixel binning followed by luminance-guided umsampling. For example, an image sensor array is configured according to a red-green-blue-luminance (RGBL) CFA pattern, such that at least 50-percent of the imaging pixels of the array are luminance (L) pixels. Pixel binning is used during readout of the array to concurrently generate a downsampled RGB capture frame and a downsampled L capture frame. Following the readout, the L capture frame is upsampled (e.g., by upscaling and interpolation) to generate an L guide frame with 100-percent luminance density. An upsampled RGB frame can then be generated by interpolating the RGB capture frame based both on known neighboring RGB information (e.g., from the RGB capture frame and previously interpolated information), as adjusted based on local luminance information from the L guide frame.