Imaging Device Pupil Division Blend Ratio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging apparatuses generate blurred images with lower resolution than the original sensor resolution when using the average of left and right pixel values, regardless of the focal point, leading to suboptimal image capture.
Innovation Solution
The imaging apparatus effectively uses respective pixel signals of divided pixels by pupil division immediately below a microlens, employing a blend ratio calculation based on disparity vectors to differentiate between focal and non-focal points, allowing for high-resolution image capture by treating pixel signals independently near the focal point and averaging them elsewhere.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the average of pixel values of left and right pixels is used as one pixel signal regardless of focal point, then the processing is simple, but the image resolution deteriorates to lower than original sensor resolution
Solution Approach 1:
The patent applies local quality by differentiating processing methods based on focal point status. For pixels with focal points (in-focus regions), individual pixel signals are used to maintain high resolution. For pixels without focal points (out-of-focus regions), averaging is applied to suppress noise. This localized adaptation of processing quality resolves the contradiction between processing simplicity and image resolution.
2Manufacturing precision
If individual pixel signals are used for all pixels, then image resolution is maintained, but noise increases in out-of-focus regions
Solution Approach 1:
The patent determines focal point status for each pixel and applies different processing: individual pixel signals for in-focus regions to maintain resolution, and averaged signals for out-of-focus regions to suppress noise. This localized quality adjustment resolves the contradiction between maintaining resolution and reducing noise.
Solution Approach 2:
The patent converts the harmful effect of using individual pixel signals in out-of-focus regions (noise increase) into a benefit by selectively applying averaging only where needed. The harm of noise in out-of-focus regions is transformed into an opportunity to apply noise suppression through averaging, while preserving resolution in in-focus regions.
3Object-affected harmful factors
If averaging is applied to all pixel signals, then noise is suppressed, but the effective use of pupil division pixels is lost
Solution Approach 1:
The patent applies averaging selectively only to out-of-focus pixels where noise suppression is needed, while preserving individual pixel signals for in-focus pixels. This localized application prevents information loss in regions where it is not needed, resolving the contradiction between noise suppression and information preservation.
Solution Approach 2:
Instead of applying averaging to all pixels (excessive action), the patent applies it only partially to out-of-focus pixels. This partial action achieves noise suppression where necessary without unnecessarily discarding valuable pixel information in in-focus regions.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present disclosure relates to an imaging apparatus and an imaging method, and an image processing apparatus and an image processing method each capable of capturing a high resolution image by effectively using respective pixel signals of a plurality of pixels defined by pupil division immediately below a microlens. A disparity is detected in units of pupil on the basis of respective pixel values of a plurality of divided pixels defined by pupil division. The pixel values of the plurality of divided pixels are added in units of pupil to obtain an added pixel value. The pixel value of the divided pixel and the added pixel value are blended in units of divided pixel in accordance with the disparity. The present disclosure is applicable to an imaging apparatus.