Image Sensor Pixel Transmittance for Multi-Viewpoint Capture
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image capturing systems require image sensors with an extremely large number of pixels to acquire multiple viewpoint images, leading to increased costs and data volume, and struggle to provide correct information when capturing moving objects.
Innovation Solution
An image capturing apparatus with an image sensor that includes multiple pixels with transmittance distribution providers, allowing for the production of high-resolution images by providing different transmittance distributions to adjacent pixels, enabling the separation of images captured from different pupils through an image processing technique.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If an image sensor with an extremely large number of pixels is used to acquire multiple viewpoint images, then multiple high-resolution images corresponding to different pupils can be obtained, but the cost of the image sensor and the image data volume increase
Solution Approach 1:
The invention divides the image sensor into multiple pixel groups, where each group corresponds to a specific pupil area. By segmenting the sensor into regions that capture light from different pupils, the system can acquire multiple viewpoint images without requiring an extremely large total number of pixels. Each pixel group uses a smaller number of pixels optimized for its specific pupil area, reducing the overall pixel count while maintaining multiple viewpoint capability.
Solution Approach 2:
The invention introduces a new dimension of pupil area classification by assigning different transmittance distributions to different pixel groups based on their corresponding pupil areas. This dimensional classification allows the system to encode viewpoint information in the transmittance distribution domain rather than requiring spatial separation of all viewpoint data across a massive pixel array, thereby reducing the total pixel requirement.
2Measurement precision
If pixel-shifting super-resolution is used to acquire high-resolution multiple viewpoint images with a small number of pixels, then resolution can be improved, but temporally shifted images are acquired which cannot provide correct information for moving objects
Solution Approach 1:
The invention applies transmittance distributions to pixel groups in advance, before image capture, such that each pixel group is pre-configured to capture light from a specific pupil area. This preliminary configuration enables simultaneous capture of multiple viewpoint images in a single exposure, eliminating the temporal shifting problem inherent in pixel-shifting methods while maintaining high resolution through the pre-established transmittance distribution mapping.
3Ease of manufacture
If multiple pixels are assigned the same transmittance distribution, then manufacturing is simplified, but image processing complexity increases to separate images from different pupils
Solution Approach 1:
The invention applies different transmittance distributions to different pixel groups based on their local correspondence to specific pupil areas. This local differentiation allows the image processing algorithm to easily identify and separate images from different pupils by simply matching the known transmittance distribution of each pixel group with its corresponding pupil area, thereby reducing processing complexity compared to scenarios where all pixels have identical transmittance characteristics.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the acquisition of multiple high-resolution images with a smaller number of pixels, reducing costs and data volume, while maintaining accurate information capture, including moving objects.
Implementation Method 1
multiple pixels each including at least one photoelectric convertor
Implementation Method 2
a transmittance distribution depending on an incident angle of the light
Data Source
AI summary
The image capturing apparatus includes an image sensor including multiple pixels each including at least one photoelectric convertor and a transmittance distribution provider to provide, to at least part of the multiple pixels, a transmittance distribution depending on an incident angle of light. The multiple pixels includes an adjacent pixel group that includes a first pixel and second pixels adjacent to the first pixel, the adjacent pixel group including pixels to which mutually different four or more kinds of the transmittance distributions are provided. The apparatus produces, by using an input image produced from an output of the image sensor and information on the transmittance distributions, an output image corresponding to an optical observation image observable when an object space is observed from a partial area of a pupil of an imaging optical system.