Image Sensor Pixel Layout for 3D Depth and Low-Light SNR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image sensors and processing systems struggle to efficiently process images in varying lighting conditions and capture three-dimensional depth information while maintaining high signal-to-noise ratios.
Innovation Solution
A pixel array arrangement with specific patterns of infrared, red, green, and blue pixels, combined with mode operations like depth, remosaic, and 2-sum modes, allows for improved image data generation under different illuminance conditions, including 3D depth information and enhanced SNR.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a conventional pixel array pattern is used, then the device complexity is low, but the ability to capture 3D depth information and maintain high signal-to-noise ratio in low illuminance conditions deteriorates
Solution Approach 1:
The pixel array is segmented into multiple 2x2 pixel groups, with each group containing one infrared pixel and three visible light pixels (red, green, blue). This segmentation allows the system to capture both depth information (via infrared pixels) and color information (via visible light pixels) simultaneously, improving the signal-to-noise ratio without requiring a completely complex redesign of the pixel structure
Solution Approach 2:
The pixel array pattern is designed to serve multiple functions: infrared pixels capture depth information, while red, green, and blue pixels capture color information. The same pixel array structure supports both depth mapping and high-quality color imaging, making the system universally applicable to various imaging tasks without requiring separate dedicated arrays for each function
2Adaptability or versatility
If infrared pixels are added to capture depth information, then the 3D depth information capture capability is improved, but the image resolution and lighting condition adaptability deteriorate
Solution Approach 1:
The pixel array is divided into 2x2 groups where one pixel is dedicated to infrared depth capture and three pixels are dedicated to visible light color capture. This segmentation ensures that depth information and color information are captured simultaneously without compromising either function, maintaining full image resolution while adding depth capability
Solution Approach 2:
The patent adds a new dimension to the traditional 2D color image by incorporating infrared pixels that capture depth information along the Z-axis. This creates a 3D representation of the scene while maintaining the original 2D color image quality, effectively adding depth capability without sacrificing image resolution
3Adaptability or versatility
If a fixed pixel pattern is used, then the manufacturing precision is high, but the adaptability to varying lighting conditions and processing modes deteriorates
Solution Approach 1:
The pixel array pattern is designed with flexibility in mind, allowing the same physical structure to support multiple processing modes (depth mode, remosaic mode, 2-sum mode) through software control. The pattern can be dynamically interpreted differently based on lighting conditions and processing requirements, enabling adaptability without requiring multiple physical arrays
Solution Approach 2:
The pixel array pattern is designed to serve multiple functions: infrared pixels capture depth information, while red, green, and blue pixels capture color information. The same pixel array structure supports both depth mapping and high-quality color imaging, making the system universally applicable to various imaging tasks without requiring separate dedicated arrays for each function
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables the capture of 3D depth information and improves signal-to-noise ratio by 3 dB in low illuminance conditions, while maintaining image resolution and quality across varying lighting scenarios.
Implementation Method 1
Image sensing devices are devices for capturing images using the property of a semiconductor which reacts to light
Data Source
AI summary
Disclosed is an image sensor including a pixel array having a pixel pattern in which first to fourth 2×2 pixel groups are arranged in a clockwise direction, one infrared pixel is arranged in each of two 2×2 pixel groups that are not adjacent to each other, the same green pixels are arranged in a first diagonal direction, and red pixels and blue pixels are arranged in half in a second diagonal direction crossing the first diagonal direction, in a 4×4 unit pixel group.