Microlens Array Pixel Signal Selection for HDR Image Generation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing imaging apparatuses cannot simultaneously acquire images from different viewpoints and generate high dynamic range (HDR) images effectively, as they lack a configuration to utilize pupil division pixels assigned to one microlens for HDR image generation.
Innovation Solution
An imaging apparatus with a microlens array between the imaging optical system and a plurality of pixels, where pixel signals are selected based on brightness and positions relative to microlenses to generate an HDR image, allowing for simultaneous acquisition of images from different viewpoints and dynamic range expansion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a microlens array with pupil division pixels is used to simultaneously acquire images from different viewpoints, then the ability to capture multi-viewpoint images is improved, but the capability to generate HDR images is lost without proper selection mechanisms
Solution Approach 1:
The patent assigns different functional qualities to different pixels under the same microlens. Specifically, pixels are categorized into first pixels and second pixels based on their relative positions to the microlens center. First pixels (closer to center) are used for standard imaging, while second pixels (farther from center) are used for HDR imaging. This local differentiation allows the system to simultaneously maintain both multi-viewpoint acquisition and HDR generation capabilities.
Solution Approach 2:
The patent segments the pixel array into multiple functional groups based on their spatial relationship with microlenses. By dividing pixels into first pixels and second pixels with different aperture ratios, the system can process different types of imaging data simultaneously. This segmentation enables independent optimization of standard imaging and HDR imaging functions.
2Illumination intensity
If pixel signals are selected based on brightness and positions to generate HDR images, then the dynamic range is expanded and overexposure/underexposure is prevented, but the device complexity increases
Solution Approach 1:
The patent performs preliminary classification of pixels into first pixels and second pixels based on their fixed geometric relationships with microlenses before imaging. The aperture ratios are predetermined by the pixel positions relative to microlens centers. This preliminary arrangement simplifies the HDR generation process, as the system only needs to select signals based on pre-established positional criteria rather than performing complex real-time analysis.
Solution Approach 2:
The system uses the inherent geometric structure of the microlens-pixel array to automatically determine which pixels should be used for HDR imaging. The relative positions of pixels to microlenses self-organize the aperture ratios, eliminating the need for external control mechanisms. The system leverages its own structural properties to perform HDR signal selection.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the generation of HDR images by selecting pixel signals based on brightness and positions, effectively expanding the dynamic range and preventing overexposure or underexposure, even in varying lighting conditions.
Implementation Method 1
an image sensor including a microlens array between an imaging optical system and a plurality of pixels and configured to receive a light flux from each of microlenses in the microlens array at the plurality of pixels
Implementation Method 2
configured to select, among a plurality of pixel signals captured at different viewpoints corresponding to a subject in the image signal from the image sensor, the pixel signal based on the brightness of the pixel signal and positions of the pixels at which the plurality of pixel signals are output relative to each of the microlenses
Data Source
AI summary
An imaging apparatus includes an image sensor including a microlens array between an imaging optical system and a plurality of pixels and configured to receive a light flux from each of microlenses in the microlens array at the plurality of pixels to output an image signal, and a generation unit configured to select, among a plurality of pixel signals obtained at different viewpoints corresponding to a subject in the image signal from the image sensor, the pixel signal based on the brightness of the pixel signal serving as a reference and positions of the pixels at which the plurality of pixel signals are output relative to each of the microlenses, to generate an output image.