Light Field Microscopy Synthesizing 3D Views from Phase Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current microscopes are limited to generating two-dimensional images, making it difficult to obtain three-dimensional views of samples, which are essential for better understanding feature shape, topography, and spatial distribution, and existing methods for generating 3D images are computationally slow and result in limited information or artifacts.
Innovation Solution
Synthesizing a light field representation based on bright field and phase image data acquired by a microscope, using mean ray pointing direction data from phase images and intensity data to calculate a light field, allowing for novel post-processing techniques like perspective views and 3D rendering without additional Z-scan data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If 3D images are acquired by scanning the axial depth of focus through the sample, then three-dimensional views of the sample are obtained, but the computation required makes these techniques slow and non-real time
Solution Approach 1:
The patent performs preliminary action by capturing the complete light field data (including angular and spatial information) in a single shot using a light field microscope, rather than performing computationally intensive 3D reconstruction after sequential Z-stack acquisition. This preliminary capture of all necessary data in one measurement enables real-time 3D visualization without post-processing delays.
Solution Approach 2:
The patent replaces the mechanical scanning system (physical movement through Z-stack acquisition) with a computational approach using light field synthesis. Instead of mechanically moving the focal plane to capture multiple 2D images for 3D reconstruction, the system uses angular information from the light field camera to computationally generate 3D views from a single captured light field dataset.
2Loss of information
If 3D images are acquired by scanning the axial depth of focus through the sample, then three-dimensional views of the sample are obtained, but discrete axial sampling results in limited 3D information or artifacts in the 3D view
Solution Approach 1:
The patent transitions from capturing only spatial information (2D images at discrete Z-planes) to capturing four-dimensional light field information that includes both spatial and angular dimensions. By measuring the angular distribution of light rays in addition to spatial intensity, the system obtains continuous 3D information without discrete sampling artifacts, enabling accurate 3D reconstruction through light field synthesis rather than traditional focal stack processing.
3Loss of information
If a light-field camera employs a microlens array in front of its image sensor to capture four-dimensional light field data, then both intensity components and directional components of light rays are collected, but the device complexity increases
Solution Approach 1:
The patent makes the microscope system multi-functional by integrating light field capture capability into the existing microscope optical path. The same objective lens and detector used for conventional 2D microscopy are utilized to capture light field data by measuring both intensity and angular information simultaneously. This universal approach allows the microscope to perform both traditional imaging and light field imaging without requiring separate dedicated hardware systems.
4Device complexity
If conventional microscopes are used to generate two-dimensional images, then the imaging process is simple, but three-dimensional views of the sample cannot be obtained
Solution Approach 1:
The patent changes the measurement parameters from conventional 2D intensity-only detection to four-dimensional light field detection that includes angular information. By measuring the angular distribution of light rays in addition to spatial intensity, the system extracts depth and 3D structural information that is inherently present in the light field but invisible to conventional 2D cameras. This parameter expansion enables 3D visualization while maintaining compatibility with standard microscope hardware.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables the generation of three-dimensional images and perspective views of samples, providing additional structural context and overcoming the limitations of traditional 2D imaging, while maintaining spatial resolution and reducing computational complexity.
Implementation Method 1
acquiring phase image data for a plurality of pixels of the sample
Data Source
AI summary
A light field representation of a sample is synthesized or simulated based on bright field image data and phase image data acquired by a microscope such as a quantitative phase microscope. The light field representation may be utilized to render three-dimensional representations of the sample.