CMOS Image Sensor Pixel Array Color Depth Data Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing devices face challenges in efficiently outputting color and depth data from phase difference auto-focus pixel arrays, leading to deteriorated image quality due to irregular operation of shielded and unshielded photodiodes in phase difference detection methods.
Innovation Solution
An image processing device is designed with a pixel array integrated into a CMOS image sensor chip, featuring a color data processing circuit, depth data extraction circuit, and output control circuit to manage the output of color and depth data in parallel or serial manners, utilizing multiple photodiodes with independent exposure times to enhance dynamic range and image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If phase difference detection is implemented using shielded and unshielded photodiodes, then depth data can be extracted, but image quality deteriorates due to irregular operation of the two pixel types
Solution Approach 1:
The pixel array is segmented into dedicated color imaging pixels and dedicated phase difference detection pixels. Color pixels capture full-color images while phase difference pixels (with shielded photodiodes) capture depth information. This segmentation allows each pixel type to be optimized for its specific function, preventing the image quality deterioration that occurs when both functions share the same pixels.
Solution Approach 2:
The phase difference detection function is extracted from the color imaging pixels and assigned to separate dedicated pixels. By taking out the depth detection function from the color imaging pathway, the patent eliminates the conflict between regular color pixel operation and phase difference detection, thereby maintaining high image quality while enabling depth data extraction.
2Loss of information
If color data and depth data are both extracted and output, then comprehensive image information is provided, but processing complexity and output management become challenging
Solution Approach 1:
The output control is segmented into separate pathways for color data and depth data. The processor independently manages color image data from color pixels and depth data from phase difference pixels, allowing each data type to be processed and output according to its specific requirements without interfering with the other.
Solution Approach 2:
The patent implements dynamic output control where the processor can flexibly manage the timing and manner of outputting color and depth data. This dynamic control allows the system to adapt to different application requirements, outputting only the necessary data types at different times, thereby reducing processing complexity while maintaining information completeness.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables improved image quality by effectively extracting and outputting color and depth data, enhancing the dynamic range and resolution of images captured by the image sensor, while maintaining efficient operation of both color and depth data processing.
Implementation Method 1
a pixel array including pixels two-dimensionally arranged and configured to capture an image, each of the pixels including a plurality of photoelectric conversion elements
Data Source
AI summary
In an example embodiment, an image processing device includes a pixel array including pixels two-dimensionally arranged and configured to capture an image, each of the pixels including a plurality of photoelectric conversion elements and an image data processing circuit configured to generate image data from pixel signals output from the pixels. The image processing device further includes a color data processing circuit configured to extract color data from the image data and output extracted color data. The image processing device further includes a depth data extraction circuit configured to extract depth data from the image data and output extracted depth data. The image processing device further includes an output control circuit configured to control the output of the color data and the depth data.