Focused Plenoptic Camera Super-Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional cameras fail to capture the directional information of light, resulting in a loss of optical data and limitations in image resolution, while light-field cameras can capture this information but struggle with achieving high-resolution images due to their inherent design.
Innovation Solution
A focused plenoptic camera is designed where the microlenses are focused on the image plane created by the main lens, rather than the main lens itself, allowing for increased spatial resolution and the application of super-resolution techniques to enhance image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a conventional camera is used to capture images, then the imaging process is simple and fast, but directional information of light is lost and image resolution is limited
Solution Approach 1:
The camera system is segmented into multiple functional components: a main lens for light collection, a microlens array for directional encoding, and a sensor for capture. Each microlens corresponds to a specific spatial location and captures light from specific directions, enabling the system to record both positional and angular information separately rather than integrating them as in conventional cameras.
Solution Approach 2:
The patent transitions from capturing only 2D spatial information to capturing 4D light-field information by adding two angular dimensions. The microlens array encodes directional information as spatial positions in the captured image, effectively mapping 4D light-field data (3D position + 1D direction) onto a 2D sensor plane through dimensional transformation.
2Loss of information
If a light-field camera with microlens array is used, then directional information is captured, but spatial resolution is reduced due to the distribution of light across multiple microlenses
Solution Approach 1:
The system performs preliminary encoding of directional information during the capture phase by using the microlens array to map angular information to spatial positions. This preliminary organization of light-field data allows subsequent computational processing to reconstruct high-resolution images without losing directional information, as the encoding is already performed in the optimal format.
Solution Approach 2:
The patent changes the interpretation parameters of the captured light-field data through computational processing. By adjusting how the encoded angular and spatial information is decoded and recombined, the system can optimize for different output resolutions and viewing conditions, transforming the fixed captured data into flexible high-resolution images.
3Device complexity
If microlenses are focused on the main lens as in conventional plenoptic cameras, then the optical path is simplified, but the image quality and resolution are compromised
Solution Approach 1:
Instead of focusing the microlenses on the main lens aperture as in conventional plenoptic cameras, this patent inverts the approach by focusing the microlenses on the image plane where the final image is formed. This inversion allows each microlens to capture a focused portion of the final image with preserved spatial details, rather than capturing a blurred aperture image.
Solution Approach 2:
The patent replaces the purely optical focusing mechanism with a hybrid optical-computational approach. While the optical system (lenses and sensor) remains relatively simple, computational processing is introduced to analyze and reconstruct the light-field data, substituting complex optical arrangements with algorithmic image processing to achieve high resolution.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables the capture of high-resolution images that meet modern photography standards, with a significant increase in spatial resolution and the ability to apply super-resolution techniques, making light-field photography more practical.
Implementation Method 1
the main lens maps the 3D world of the scene outside camera into a 3D world inside camera
Implementation Method 2
each microlens is focused on a different region of the sensor
Data Source
AI summary
Methods and apparatus for super-resolution in focused plenoptic cameras. By examining the geometry of data capture for super-resolution with the focused plenoptic camera, configurations for which super-resolution is realizable at different modes in the focused plenoptic camera are generated. A focused plenoptic camera is described in which infinity is super resolved directly, with registration provided by the camera geometry and the microlens pitch. In an algorithm that may be used to render super-resolved images from flats captured with a focused plenoptic camera, a high-resolution observed image is generated from a flat by interleaving pixels from adjacent microlens images. A deconvolution method may then be applied to the high-resolution observed image to deblur the image.