Hybrid Plenoptic Camera with Moveable Micro-Lens Array
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing plenoptic cameras face challenges with low spatial and angular resolution, irregular color sampling, and inefficient de-mosaicking processes due to fixed micro-lens arrays and Bayer-pattern color filters, leading to monochromaticism and image quality issues.
Innovation Solution
A plenoptic camera with a moveable micro-lens array synchronized by a prime mover for multi-resolution capture and an additional motor displacing the image sensor to enhance color sampling, mimicking the human visual system's jiggling motion for improved color resolution, allowing for hybrid operation combining the advantages of different camera types.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a fixed micro-lens array is used in a plenoptic camera, then the camera can capture light field information, but the spatial resolution and angular resolution are limited and cannot be simultaneously optimized
Solution Approach 1:
The micro-lens array is made movable relative to the image sensor through a displacement mechanism, allowing dynamic adjustment of the distance between the micro-lens array and the image sensor. This enables the system to switch between different capture modes (e.g., high spatial resolution mode and high angular resolution mode) by changing the relative position, thus resolving the contradiction between fixed resolution limitations and the need for resolution flexibility.
2Quantity of substance
If a Bayer-pattern color filter is used, then color information can be captured, but the color sampling suffers from big spatial gaps and monochromaticism
Solution Approach 1:
The displacement mechanism allows the micro-lens array to be positioned at different distances from the image sensor, which changes the sampling pattern of the Bayer filter. By adjusting the position, the system can reduce the spatial gaps in color sampling and mitigate monochromaticism, thereby improving color sampling quality while still capturing color information.
3Quantity of substance
If de-mosaicking is performed on de-multiplexed views, then color information can be reconstructed, but the process requires complex pre-processing and yields lower quality
Solution Approach 1:
By dynamically adjusting the distance between the micro-lens array and the image sensor, the system can capture light field information in a manner that reduces the need for complex pre-processing. The adjusted positioning allows for more direct and simpler de-mosaicking operations, reducing computational complexity while maintaining or improving color information quality.
4Measurement precision
If the micro-lens array is moved to achieve multi-resolution capture, then spatial and angular resolution can be optimized, but the device complexity increases
Solution Approach 1:
The patent implements a mechanical displacement system that allows the micro-lens array to be moved to different positions relative to the image sensor. This dynamic positioning capability enables the camera to capture light field information at multiple resolutions, optimizing both spatial and angular resolution as needed.
Solution Approach 2:
The movable micro-lens array system serves multiple functions: it can capture high spatial resolution images, high angular resolution light field data, and perform de-mosaicking with reduced pre-processing requirements. This multi-functionality justifies the added mechanical complexity by providing a versatile platform for various imaging needs.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution achieves high spatial and angular resolution, improved color resolution, and simplifies the de-mosaicking process by reducing the need for pre-processing, resulting in richer chromatic information and enhanced light field capture.
Implementation Method 1
a moveable micro-lens array in optical registration with an image sensor
Implementation Method 2
A first prime mover that displaces the micro-lens array synchronized with a frame rate for the camera to obtain multi-resolution of a scene
Implementation Method 3
A second motor displacing the image sensor to increase color sampling
Implementation Method 4
A Bayer-pattern color filter filters light incident on the individual light-sending elements of the camera image sensor
Data Source
AI summary
A plenoptic camera has a moveable micro-lens array in optical registration with an image sensor. A first prime mover displaces the micro-lens array synchronized with a frame rate for the camera to obtain multi-resolution of a scene. A second prime mover displaces the image sensor to increase color sampling.