Integrated Image Sensor for 3D Shape via Phase and Polarization Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current image sensors struggle to effectively generate three-dimensional shape and depth images due to registration errors between depth and polarization information, requiring separate sensors and complex systems.
Innovation Solution
An image sensor integrating phase detection photodiodes and polarization detection photodiodes with shared microlenses and color filters, allowing for simultaneous collection of depth and polarization information to disambiguate surface normals and create detailed three-dimensional images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If separate sensors are used for depth and polarization information, then measurement completeness is improved, but device complexity increases and registration errors occur
Solution Approach 1:
The patent combines phase detection photodiodes and polarization detection photodiodes into a single integrated image sensor array. Each pixel location contains both types of photodiodes that share common microlenses and color filters, allowing simultaneous capture of depth and polarization information from the same spatial position. This merging eliminates registration errors between separate sensors while reducing overall device complexity.
Solution Approach 2:
The image sensor is designed with multi-functional pixels that can simultaneously perform phase detection for depth measurement and polarization detection for surface normal analysis. The shared optical components (microlenses and color filters) serve multiple detection functions, making the sensor universally capable of capturing both depth and polarization data without requiring separate dedicated sensors.
2Measurement precision
If separate sensors are used for depth and polarization information, then measurement completeness is improved, but registration errors occur
Solution Approach 1:
By integrating both phase detection and polarization detection photodiodes at the same pixel locations with shared optical components, the patent ensures that depth and polarization information are captured from identical spatial positions and optical paths. This eliminates registration errors that occur when using separate sensors, as both measurement types are inherently aligned by construction.
3Device complexity
If integrated sensor is used, then device complexity is reduced and registration errors are eliminated, but manufacturing precision requirements increase
Solution Approach 1:
The patent implements local differentiation within the sensor array by creating distinct photodiode regions (phase detection vs. polarization detection) at each pixel location while maintaining shared optical components. This local quality approach allows for specialized detection functions at each position while using common optical paths, reducing the overall manufacturing precision requirements compared to fully independent sensor systems.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This integrated approach eliminates registration errors, simplifies the device architecture, and enhances the quality of three-dimensional shape images by directly combining depth and polarization data within a single sensor.
Implementation Method 1
Each of the plurality of pixels may include a first pair of photodiodes optically aligned with a first color filter and a first microlens that share the first color filter and the first microlens
Implementation Method 2
Each of the plurality of pixels may include a second pair of photodiodes optically aligned with a second color filter and a second microlens that share the second color filter and the second microlens
Implementation Method 3
a first microlens that shares the first color filter and the first microlens with the first pair of photodiodes
Implementation Method 4
Each of the plurality of pixels may include a first pair of photodiodes optically aligned with a first color filter
Implementation Method 5
The image sensor includes an array of pixels having photosensitive elements (e.g., photodiodes) that absorb a portion of the incident image light and generate image charge upon absorption of the image light
Data Source
AI summary
In some embodiments, an image sensor is provided. The image sensor comprises a plurality of photodiodes arranged as a photodiode array. The plurality of photodiodes includes a first set of photodiodes configured as phase detection photodiodes, and a second set of photodiodes configured as polarization detection photodiodes. In some embodiments, a controller is provided. The controller comprises circuitry configured to process signals from a first set of photodiodes of a photodiode array to obtain depth information; process signals from a second set of photodiodes of the photodiode array to obtain polarization information; process the polarization information to obtain an ambiguous set of surface normals; and process the ambiguous set of surface normals using the depth information to obtain a three-dimensional shape image.