Lens Stack Array Imaging for Super-Resolution Under Low-Light Limits
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image sensors in cameras, particularly those in mobile systems, face performance constraints such as low light sensitivity, reduced signal-to-noise ratio, and limited dynamic range due to small pixel size and color filters, leading to poor image quality in low light conditions.
Innovation Solution
A camera array comprising a plurality of imagers with varying imaging characteristics, including different filters, exposure times, and lens configurations, combined through super-resolution processing to enhance image quality and capture high dynamic range, panoramic, and hyper-spectral images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a single image sensor with color filters is used, then the device structure is simple, but light sensitivity and signal-to-noise ratio are reduced
Solution Approach 1:
The patent divides the imaging function into multiple independent imagers, each dedicated to capturing light in a specific wavelength range. This segmentation allows each imager to be optimized for its specific spectral band, eliminating the need for color filters and improving overall light sensitivity while maintaining manageable device complexity through modular architecture
Solution Approach 2:
Each imager in the array is assigned specific local characteristics including dedicated wavelength ranges, unique lens configurations, and specialized filters. This local optimization allows each imaging element to maximize its performance for its specific spectral domain, improving signal-to-noise ratio without compromising overall system simplicity
2Volume of moving object
If pixel size is reduced for mobile systems, then device miniaturization is achieved, but dynamic range and image quality deteriorate
Solution Approach 1:
The patent combines multiple imagers with different spectral sensitivities into a single array that functions as an integrated imaging system. By merging the capabilities of multiple dedicated imagers, the system achieves enhanced dynamic range and image quality equivalent to or better than a single large sensor, while maintaining a compact form factor suitable for mobile devices
Solution Approach 2:
The patent adds spectral dimensionality to the imaging approach by capturing multiple wavelength bands simultaneously across the image array. This dimensional expansion allows the system to recover lost dynamic range and image quality information through spectral diversity, compensating for the reduced spatial dimensions imposed by smaller pixel sizes
3Loss of information
If color filters are applied to each pixel, then color information is captured, but light sensitivity and signal-to-noise ratio are reduced
Solution Approach 1:
Instead of filtering light at the pixel level, the patent segments the spectral capture function across multiple imagers, each dedicated to specific wavelength ranges. This approach eliminates the light-blocking effect of color filters while maintaining color information through the spectral sensitivity characteristics of individual imagers, thereby improving signal-to-noise ratio
Solution Approach 2:
The patent changes the fundamental parameter of spectral capture from spatial filtering (color filters) to spectral sensitivity (wavelength-specific imagers). This parameter transformation allows the system to maintain color information through the spectral response characteristics of each imager rather than through light-blocking filters, improving signal quality
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution improves image quality by increasing light sensitivity, dynamic range, and resolution, enabling high-quality images in low light conditions and providing features like panoramic and hyper-spectral imaging.
Implementation Method 1
lens stack arrays that can be utilized in camera arrays
Implementation Method 2
The image sensor consists of pixels that generate signals upon receiving light via the optical element
Data Source
AI summary
Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.