Adaptive Gradation Processing for Pupil Division Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image processing technologies lack the ability to adaptively perform gradation processes on images with multiple high-brightness-side gradation distributions during the developing process, particularly for images captured by pupil division type imaging elements, which limits the dynamic range expansion and introduces noise or color artifacts.
Innovation Solution
An image processing apparatus and method that acquires and processes visual point image data with different visual points, allowing for adaptive gradation processes using both first and second processing units to output images with expanded dynamic range while minimizing noise and color distortion, by employing pupil division type imaging elements and dynamic range extension techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a single gradation process is used for developing image data, then the processing is simple and fast, but the dynamic range is limited and high-brightness details are lost due to clipping
Solution Approach 1:
The patent implements dynamic selection between multiple gradation processing methods (first gradation processing and second gradation processing) based on the characteristics of the input image data. The system adaptively switches processing modes to optimize both simplicity and accuracy for different image scenarios, resolving the contradiction between processing complexity and gradation accuracy.
Solution Approach 2:
The patent changes the processing parameters by introducing multiple gradation processing methods with different characteristics. The first gradation processing handles normal dynamic range images, while the second gradation processing specifically addresses high-brightness regions with clipped data, allowing the system to achieve higher gradation accuracy without permanently increasing overall system complexity.
2Manufacturing precision
If multiple gradation processes are performed on the entire image, then the dynamic range is expanded and high-brightness details are preserved, but processing time increases and computational load becomes excessive
Solution Approach 1:
The patent applies the second gradation processing only to specific high-brightness image areas where clipping has occurred, rather than processing the entire image. This localized approach preserves dynamic range in critical regions while minimizing unnecessary processing time and computational load on the rest of the image.
Solution Approach 2:
The patent segments the image processing into two distinct pathways: first gradation processing for normal regions and second gradation processing for high-brightness regions with clipped data. This segmentation allows the system to apply comprehensive processing only where needed, reducing overall processing time while maintaining expanded dynamic range in critical areas.
3Manufacturing precision
If pupil division type imaging elements are used to capture images with different visual points, then the dynamic range is enlarged, but noise and color artifacts are introduced in the combined image
Solution Approach 1:
The patent converts the harmful effect of clipping in high-brightness regions into a beneficial opportunity by introducing a second gradation processing method specifically designed to handle clipped data. This method recovers high-brightness details that would otherwise be lost, transforming the limitation of single-exposure imaging into an advantage through multi-exposure combination.
Solution Approach 2:
The patent introduces an intermediary processing step (second gradation processing) that acts as a mediator between the first gradation processing results and the final output image. This intermediary process specifically addresses color artifacts and noise by performing additional gradation adjustments on high-brightness regions, thereby reducing harmful effects while preserving the expanded dynamic range.
Data Source
AI summary
An image processing apparatus can acquire a plurality of pieces of visual point image data having different visual points from an imaging element having a pupil division pixel, and perform a gradation process on an image. When there are a plurality of types of high-brightness-side gradation distributions which can be reflected at a developing time, the image processing apparatus displays a user interface screen on a display unit and displays a histogram representing brightness of an image for each high brightness gradation improvement method. An area in which high brightness gradation is adjustable is displayed on a displayed image to be distinguished for each of the high brightness gradation improvement methods and for each setting condition.