Stacked Image Sensor Parallel Processing for White Balance Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging apparatuses experience time lags in processing due to sequential detection methods for face detection and specular reflection component extraction, which prolong processing times for image corrections like white balance.
Innovation Solution
The imaging apparatus employs a stacked layer sensor with a first image processing unit for initial detection of specular reflection candidates and a second image processing unit for accurate extraction and white balance correction, allowing parallel processing and reduced overall processing time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sequential detection methods are used for face detection and specular reflection component extraction, then high accuracy in detection is achieved, but processing time increases significantly
Solution Approach 1:
The patent performs preliminary rough detection of face position and specular reflection components using simplified algorithms before conducting detailed accurate detection. This preliminary action provides initial results that guide subsequent processing, allowing the system to achieve high accuracy while reducing overall processing time by avoiding unnecessary detailed analysis of all image regions.
Solution Approach 2:
The detection process is segmented into multiple stages: rough face detection, rough specular reflection detection, detailed face detection, and detailed specular reflection extraction. Each stage processes only relevant regions identified in previous stages, dividing the complex detection task into manageable segments that can be executed efficiently in sequence rather than performing full detailed analysis on the entire image.
2Manufacturing precision
If detailed image processing is performed after detection, then high accuracy in image correction is achieved, but time lag increases
Solution Approach 1:
The system performs preliminary rough detection of faces and specular reflection components during the image signal readout period using simplified algorithms. This preliminary action identifies regions of interest and prepares initial correction parameters before detailed processing is required, allowing the detailed image processing to start immediately without waiting for complete detection of all image data.
Solution Approach 2:
The patent enables continuous processing by overlapping detection and processing operations. While detailed image processing is being performed on previously detected regions, the system continues to read out image signals and perform rough detection on new data. This continuous overlap of useful actions eliminates idle waiting time and maintains high throughput while achieving accurate correction results.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables faster image processing by completing initial detection and extraction tasks concurrently with image signal readout, significantly reducing the total processing time for image corrections.
Implementation Method 1
Each of the plurality of pixels has a photoelectric conversion unit which converts light into an electric charge
Data Source
AI summary
An imaging apparatus includes an image sensor, a control unit, a first image processing unit, and a second image processing unit. The image sensor includes a plurality of pixels, each of which includes a photoelectric conversion unit which converts light into an electric charge. The control unit makes a first control line output a signal based on the electric charge of the photoelectric conversion unit to a first signal line, and makes a second control line output a signal based on the electric charge of the photoelectric conversion unit to a second signal line. The first image processing unit performs first image processing for the signal output to the second signal line. The second image processing unit performs second image processing for the signal output to the first signal line based on a result of the first image processing in the first image processing unit.