Multi-Image Capture System Depth Resolution via Beamsplitter and Data Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing multi-image capture systems face limitations in achieving high spatial resolution for depth maps due to the number of pixels in the photodetector array, which is expensive and results in unacceptably low resolution for depth images.
Innovation Solution
A multi-image capture system that uses a beamsplitter to direct light to both a plenoptic photodetector array for depth images and a high-definition photodetector array for a main image, allowing the data processor to upconvert and interpolate depth images to achieve higher resolution without increasing the number of pixels in the photodetector array.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the number of pixels in the photodetector array is increased to improve depth map spatial resolution, then the measurement precision of depth images is improved, but the device cost increases significantly
Solution Approach 1:
The system divides the photodetector array into multiple macropixels, where each macropixel is further subdivided into multiple pixels. This segmentation allows the depth information to be captured through computational processing rather than requiring each pixel to directly contribute to depth resolution, thereby reducing the total pixel count needed while maintaining depth map quality
Solution Approach 2:
The patent introduces a computational processing stage that acts as an intermediary between the photodetector array and the final depth map output. By processing data from multiple macropixels and using algorithms to reconstruct depth information, the system achieves high depth resolution without requiring a proportional increase in physical pixel count, thus reducing device cost
2Measurement precision
If the number of microlenses is increased to improve depth image spatial resolution, then the measurement precision of depth images is improved, but the device complexity increases
Solution Approach 1:
Each microlens serves multiple functions: it focuses light for standard image capture and simultaneously enables depth information acquisition through its spatial relationship with macropixels. This multi-functionality allows the system to achieve both high-resolution imaging and depth mapping without requiring separate components, thereby reducing overall device complexity
Solution Approach 2:
The patent merges the depth sensing function with the standard imaging function by integrating microlenses directly onto the photodetector array. This combination eliminates the need for separate depth sensing hardware, reducing device complexity while maintaining depth image resolution through computational processing of the integrated sensor data
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances the spatial resolution of depth maps by utilizing the higher resolution of the main image to upscale low-resolution depth images, enabling the capture of high-definition images with associated depth maps without sacrificing resolution.
Implementation Method 1
a beamsplitter positioned on the optical path between the imaging lens and the array of micro-imaging elements to redirect at least a second portion of the light received from the imaging lens to at least a second image field of the imaging lens
Implementation Method 2
a plurality of micro-lenses distributed about the image field of the converging lens such that each micro-lenses receives light from the converging lens and forms an image from the light it receives
Implementation Method 3
each pixel being able to generate an image data indicative of the intensity of light incident upon it
Data Source
AI summary
The multi-image capture system comprises an imaging lens, a beamsplitter directing a first portion of light on an array of micro-imaging elements and a first photodetector array divided into a plurality of macropixels providing a set of depth images, and another portion of light on a second photodetector array 6 providing a main image with a resolution being higher than the resolution of each basic depth image. According to the invention, the resolution of the depth images is increased by using the image data of the main image.