Pupil Division Pixel Signal Super-Resolution Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies using pupil division cannot generate images with a higher resolution than that of each pupil unit, as they sum pixel signals in pupil units based on parallax, limiting the achievable image resolution.
Innovation Solution
An image processing device and method that adds pupil division pixel signals with multiple addition patterns in pupil units, correcting inter-pixel sensitivity differences and using super-resolution processing to generate images with higher resolution than the pixel addition image, by employing a pixel addition processing unit and an image generation processing unit that utilize different addition patterns to combine pixel signals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If pixel signals are added up in pupil units based on parallax to generate an addition pixel signal, then the processing is simple and can be implemented, but the image resolution cannot exceed that of each pupil unit
Solution Approach 1:
The patent segments the pupil division pixel signals into multiple different addition patterns (first addition pattern, second addition pattern, etc.). Each pattern processes signals differently, and the results are combined to achieve super-resolution. This segmentation allows the system to overcome the resolution limit of individual pupil units while maintaining manageable processing complexity through structured pattern-based operations.
Solution Approach 2:
The patent introduces a new dimension of processing by using multiple addition patterns that operate in different signal combination dimensions. Instead of simply summing signals in one way, the system processes signals through multiple pattern dimensions and synthesizes the results, effectively adding a dimensional aspect to the signal processing that enables resolution beyond the physical pupil unit limits.
2Measurement precision
If multiple different addition patterns are used to process pupil division pixel signals, then high-resolution images can be generated, but the processing complexity increases
Solution Approach 1:
The patent applies sensitivity difference correction to the pupil division pixel signals before performing the addition pattern processing. This preliminary correction step pre-processes the signals to account for pixel sensitivity variations, which simplifies subsequent processing and reduces the computational burden of handling multiple addition patterns, thereby reducing overall processing time while maintaining high-resolution output.
3Illumination intensity
If pixel signals from multiple pupil division pixels are combined, then signal strength increases, but inter-pixel sensitivity differences cause image quality degradation
Solution Approach 1:
The patent applies sensitivity difference correction specifically to each pupil division pixel signal individually before combination. This local quality adjustment ensures that each pixel's sensitivity characteristics are corrected according to its specific properties, allowing signals to be combined effectively without the degradation that would result from uncorrected inter-pixel sensitivity differences, thus maintaining both signal strength and image quality.
Data Source
AI summary
A pixel addition processing unit 35 adds pupil division pixel signals with a plurality of different addition patterns in pupil units to generate a pixel addition image for each addition pattern. Further, the pixel addition processing unit 35 may use a pupil division pixel signal in which a sensitivity difference between pupil division pixels has been corrected, and the addition pattern may be set on the basis of image characteristic information calculated by using the pupil division pixel signal. A super-resolution processing unit 36 performs super-resolution processing using a pixel addition image signal generated for each addition pattern by the pixel addition processing unit 35 to generate an image signal with a higher resolution than that of the pixel addition image signal. A high-resolution image can be generated using pupil division.