Light Field Microscope Resolution via Microlens Array and Scattering Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current light field microscopy techniques face challenges in achieving high-resolution, high-magnification, and high-speed 3D imaging for large biological samples, such as recording neuronal activity at single-neuron resolution, due to trade-offs between spatial and axial resolution and the cost of capturing light-field information with reduced spatial resolution.
Innovation Solution
The method involves mounting an array of microlenses between the imaging target and an image sensor, determining the light field point spread function based on calibration parameters, computing light scattering characteristics, and performing 3D deconvolution to produce volumetric information from 2D recordings, using Monte-Carlo simulations and multiple imaging modalities like two-photon or confocal excitation microscopy to enhance imaging resolution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If light field microscopy is used to capture 3D image data simultaneously, then temporal resolution is improved, but spatial resolution deteriorates
Solution Approach 1:
A microlens array is introduced as an intermediary optical element between the sample and the sensor. This array encodes 3D light field information into 2D sensor images while preserving sufficient spatial information. The microlenses act as intermediaries that capture angular and spatial information simultaneously, enabling both high temporal and spatial resolution through computational reconstruction.
Solution Approach 2:
The patent employs computational algorithms that change the processing parameters from simple 2D image capture to 4D light field reconstruction. By transforming the reconstruction process from basic deconvolution to advanced light field algorithms that incorporate microlens array calibration and light scattering compensation, the system achieves enhanced spatial resolution while maintaining high temporal resolution.
2Productivity
If light field microscopy is used for 3D imaging, then imaging speed is improved, but imaging resolution deteriorates
Solution Approach 1:
The system performs preliminary calibration of the microlens array parameters before actual imaging. By pre-characterizing the optical transfer function and light scattering properties of the sample, the reconstruction algorithm can operate more efficiently during time-resolved imaging, achieving both high speed and high resolution without sacrificing accuracy.
Solution Approach 2:
The patent replaces mechanical scanning systems with a static microlens array combined with computational reconstruction. This substitution eliminates mechanical movement, enabling high-speed imaging while the computational algorithms restore fine spatial details that would otherwise be lost in the compressed 2D projection.
3Length of stationary object
If light scattering effects are present in biological samples, then imaging depth is improved, but resolution deteriorates
Solution Approach 1:
The patent converts the harmful effect of light scattering into a useful signal by measuring and characterizing the scattering properties of the biological sample. The light scattering that degrades image quality is instead used to compute a scattering compensation factor, which is then applied during reconstruction to restore resolution while maintaining the ability to image deep within scattering tissues.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enables high-resolution, high-speed 3D imaging capable of capturing time dynamics at small scales, improving spatial and temporal resolution while accounting for light scattering effects, allowing for detailed neuronal activity recording in biological systems like C. elegans and zebrafish brains.
Implementation Method 1
mounting an array of microlenses between the imaging target and an image sensor
Implementation Method 2
Characteristics of light scattered in the imaging target and reaching the array of microlenses are computed, based on light scattering parameters of a light scattering medium of the imaging target
Data Source
AI summary
Methods and systems are provided for enhancing the imaging resolution of three dimensional imaging using light field microscopy. A first approach enhances the imaging resolution by modeling the scattering of light that occurs in an imaging target, and using the model to account for the effects of light scattering when de-convolving the light field information to retrieve the 3-dimensional (3D) volumetric information of the imaging target. A second approach enhances the imaging resolution by using a second imaging modality such as two-photon, multi-photon, or confocal excitation microscopy to determine the locations of individual neurons, and using the known neuron locations to enhance the extraction of time series signals from the light field microscopy data.