Correlation Plenoptic Imaging for Arbitrary-Plane 3D Refocusing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current plenoptic imaging systems suffer from poor resolution and limited depth of field, with existing solutions either reducing image resolution or requiring complex post-processing to achieve high-resolution images, and they do not allow real-time monitoring or effective depth of field extension.
Innovation Solution
The process involves capturing light propagation direction by measuring spatio-temporal correlations between light intensities at two arbitrary image planes, without the need for a microlens array, allowing for high-resolution images with extended depth of field and real-time monitoring.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional imaging systems are used, then images can be captured at standard planes, but images cannot be captured at arbitrary intermediate planes between the lens and the sensor
Solution Approach 1:
The patent segments the optical path by introducing a microlens array between the main lens and the sensor plane. Each microlens in the array captures light from a specific angular direction and focuses it to a corresponding point on the sensor, enabling independent capture of plenoptic information at arbitrary intermediate planes without redesigning the entire imaging system.
Solution Approach 2:
The patent transitions from capturing only 2D spatial information at fixed planes to capturing 4D plenoptic information (2D spatial + 2D angular) by adding the microlens array dimension. This enables image capture at arbitrary intermediate planes along the optical axis by processing the angular and spatial data from the microlens array outputs.
2Adaptability or versatility
If plenoptic information is captured for arbitrary plane reconstruction, then images at any depth can be reconstructed, but the amount of data to be processed increases significantly
Solution Approach 1:
The patent extracts only the necessary plenoptic information by using the microlens array to sample light rays at specific angular intervals. Rather than capturing complete plenoptic data for all possible planes, the system extracts sufficient spatial and angular information to reconstruct images at arbitrary intermediate planes through computational processing, reducing the overall data volume while maintaining reconstruction capability.
3Adaptability or versatility
If a microlens array is introduced to capture plenoptic images, then images at arbitrary intermediate planes can be captured, but the device complexity and manufacturing difficulty increase
Solution Approach 1:
The patent designs the microlens array with universal functionality where each microlens serves multiple purposes: capturing spatial information, encoding angular information, and enabling focus stacking. This multi-functionality reduces the need for additional specialized components, simplifying the overall device architecture and manufacturing process while achieving arbitrary plane capture capability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach maintains diffraction-limited resolution while significantly enhancing the depth of field, enabling real-time image refocusing and 3D imaging without the limitations of existing technologies.
Implementation Method 1
a microlens array is positioned in a plane between the lens and the sensor plane, with each microlens of the microlens array oriented to face the lens
Implementation Method 2
the microlens array is positioned in a plane between the lens and the sensor plane
Data Source
Figure 1
Figure 2A~2C
Figure 3
AI summary
A process and an apparatus are described for the plenoptic capture of photographic or cinematographic images of an object or a 3D scene (10) of interest, both based on correlated light emitting source and correlation measurement, along the line of "Correlation Plenoptic Imaging" (CPI). A first image sensor (D ɑ ) and a second image sensor (D b ) detect images along a path of a first light beam (ɑ) and a second light beam (b), respectively. A processing unit (100) of the intensities detected by the synchronized image sensors (D ɑ , D b ) is configured to retrieve the propagation direction of light by measuring spatio-temporal correlations between light intensities detected in the image planes of at least two arbitrary planes (Ρ', P"; D'b, D" a ) chosen in the vicinity of the object or within the 3D scene (10).