Image Sensor Pixel Lattice for High-Resolution Parallax and 2D Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing stereo image-capturing apparatuses using single-chip image sensors face challenges in simultaneously achieving high resolutions for 2D and parallax image data, as the resolutions of both types of data are often adversely affected when produced from the same image data.
Innovation Solution
An image sensor with a lattice of pixels, including parallax pixels with different aperture masks and color filters, and no-parallax pixels, arranged to transmit different partial luminous fluxes and wavelengths, allowing for the production of parallax and 2D image data without parallax, where parallax pixels are arranged at equal intervals and no-parallax pixels outnumber parallax pixels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If two image-capturing optical systems are arranged with predetermined distance to generate parallax, then stereoscopic image capability is improved, but device complexity and size increase
Solution Approach 1:
The patent combines two separate image-capturing optical systems into a single image sensor chip, integrating multiple photoelectric converter elements with different aperture masks and color filters on one substrate. This merging approach maintains stereoscopic capability while reducing device complexity and size compared to using two separate cameras or optical systems.
Solution Approach 2:
The single image sensor performs multiple functions simultaneously: it captures both 2D images and 3D parallax images, supports full-color imaging, and enables stereoscopic viewing. The photoelectric converter elements are designed to handle multiple imaging modes through different aperture mask configurations, making the device universal and multi-functional.
2Adaptability or versatility
If image data is used to simultaneously produce 2D image data and color parallax image data, then imaging versatility is improved, but resolution of both image types deteriorates
Solution Approach 1:
The image sensor divides the photoelectric converter elements into distinct groups: some elements are equipped with aperture masks for capturing parallax information, while others have no aperture masks for capturing 2D images. This segmentation allows each group to specialize in its function, preventing the resolution degradation that would occur if all elements tried to serve dual purposes simultaneously.
Solution Approach 2:
Different regions of the image sensor have different functional qualities: certain photoelectric converter elements have aperture masks optimized for parallax capture, while others have clear apertures optimized for 2D capture. This local differentiation ensures that each region contributes its best performance to its designated function, maintaining high resolution for both 2D and parallax images.
3Adaptability or versatility
If aperture masks are added to photoelectric converter elements to create parallax pixels, then parallax image capability is improved, but light transmission and image brightness deteriorate
Solution Approach 1:
The patent segments the photoelectric converter elements into parallax pixels with aperture masks and no-parallax pixels without masks. By not requiring every pixel to have an aperture mask, the system maintains sufficient light transmission overall while still achieving parallax capability in the regions where aperture masks are present.
Solution Approach 2:
The image sensor achieves multi-functionality by combining pixels with aperture masks (for parallax) and pixels without masks (for 2D and brightness). This universal design allows the single sensor to perform multiple imaging functions simultaneously without sacrificing overall image brightness, as the non-masked pixels compensate for the light loss in masked pixels.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This configuration enables the production of high-resolution parallax and 2D image data, improving the quality of stereoscopic views by isolating parallax effects to defocused regions, maintaining high spatial resolution in focused areas, and achieving high dynamic range images.
Implementation Method 1
aperture masks that respectively have openings positioned to transmit different partial luminous fluxes of an incident luminous flux
Implementation Method 2
color filters that respectively transmit different wavelength ranges from each other
Implementation Method 3
photoelectric converter elements each of which is associated with
Data Source
AI summary
To produce both 2D image data and color parallax image data from image data output from a single-plate image sensor, the resolutions of the 2D image data and parallax image data may be both degraded. The image sensor has a primitive lattice that is a group of pixels including (i) at least four types of parallax pixels formed by photoelectric converter elements each of which is associated with one of combinations of two different types of aperture masks and two different types of color filters and (ii) no-parallax pixels configured to guide an incident luminous flux to photoelectric converter elements without limitation. In the group of pixels, the no-parallax pixels are more than the parallax pixels.