Lens Stack Camera Array for Super-Resolution in Low-Light Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image sensors in cameras, particularly those in mobile systems, face limitations in dynamic range, signal-to-noise ratio, and low light sensitivity due to small pixel size and constraints from color filters, leading to poor performance in low light conditions.
Innovation Solution
A camera array comprising a plurality of imagers with varying imaging characteristics, including different filters and lens stacks, captures images that are combined using super-resolution processes to enhance resolution and quality, and incorporates near-IR imagers to reduce noise and improve sensitivity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single image sensor with color filters is used, then the device can capture color information, but the dynamic range and signal-to-noise ratio are limited
Solution Approach 1:
The image sensor is divided into multiple separate imagers, each dedicated to capturing a specific wavelength range (e.g., red, green, blue, and near-infrared). This segmentation allows each imager to be optimized for its specific wavelength without the constraints of color filters, thereby increasing the dynamic range and signal-to-noise ratio for each channel while maintaining overall system functionality.
Solution Approach 2:
Multiple imagers capturing different wavelength ranges are merged into a single integrated image sensor array. The outputs from these separate imagers are combined through image processing to produce a final color image with enhanced dynamic range and signal quality, effectively merging the advantages of multiple specialized sensors into one unified system.
2Length of moving object
If pixel size is reduced for mobile systems, then the device becomes more compact, but low light sensitivity deteriorates
Solution Approach 1:
Instead of relying on a single large pixel for adequate light collection, the system segments the imaging function across multiple smaller pixels, each optimized for specific wavelength ranges. This allows the device to maintain a compact form factor while collectively achieving the light sensitivity and dynamic range of larger pixels through the combined output of multiple specialized imagers.
Solution Approach 2:
The system changes the operational parameters by using multiple imagers with different spectral sensitivities rather than relying on a single imager with larger pixel area. This parameter change allows the device to achieve high light sensitivity and dynamic range while maintaining small pixel size and compact device dimensions.
3Adaptability or versatility
If color filters are used to capture color information, then color reproduction is enabled, but signal-to-noise ratio and low light performance are degraded
Solution Approach 1:
The color capture function is segmented across multiple wavelength-specific imagers rather than using a single imager with color filters. Each imager captures light in its designated wavelength range without filtering, maximizing the signal-to-noise ratio. The color information is reconstructed by combining the outputs of these specialized imagers, eliminating the signal loss inherent in color filter systems.
Solution Approach 2:
Instead of using color filters to copy color information onto a single imager, the system uses multiple imagers, each capturing a specific wavelength range. The color information is effectively copied across multiple dedicated channels, allowing for higher signal quality and dynamic range while maintaining full color reproduction capability through computational synthesis.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution achieves higher resolution, dynamic range, and sensitivity by combining images from multiple imagers with different characteristics, effectively addressing the performance constraints of conventional image sensors.
Implementation Method 1
The image sensor consists of pixels that generate signals upon receiving light via the optical element
Implementation Method 2
light enters through an opening (aperture) at one end of the imaging device and is directed to an image sensor by an optical element such as a lens
Implementation Method 3
at least one of the imagers is designed to image light in the near-infrared spectrum
Implementation Method 4
one or more layers of optical elements are placed between the aperture and the image sensor to focus light onto the image sensor
Implementation Method 5
lens stacks, captures images that are combined using super-resolution processes
Implementation Method 6
Filters are often employed in the image sensor to selectively transmit lights of certain wavelengths onto pixels
Implementation Method 7
The first imager includes a filter for transmitting a light spectrum
Data Source
AI summary
Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.