Light-Field Microscopy Using Microlens Array for Computational Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional microscopy imaging devices face limitations in capturing and manipulating light distribution, leading to issues such as diffraction-limited spatial resolution, shallow depth of field, and inability to disambiguate superimposed features, which restrict their ability to obtain accurate and detailed images, especially at high magnification.

Innovation Solution

A light-field microscopy system is implemented, comprising an objective lens, a photosensor array, and a microlens array at an intermediate image plane, which detects and processes light rays to compute two-dimensional and three-dimensional images, allowing for focus adjustment and aberration correction without moving the specimen or optics, and enabling the capture of multiple perspectives with a single photograph.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional microscopy imaging devices are used to capture light distribution, then the device structure remains simple, but the ability to obtain image data from subjects is limited and most information about light distribution is not recorded

Engineering Contradiction:
Improvelight distribution informationVSAvoidimaging device structure
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The imaging device is segmented into multiple functional components: conventional imaging lens, microlens array, and sensor array. The microlens array divides the light field into multiple sub-regions, each captured by corresponding sensor elements, enabling comprehensive recording of light distribution information without requiring a completely new device architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from conventional 2D image capture to 4D light field capture by adding angular and depth dimensions. The microlens array captures not only spatial information but also directional information of light rays, enabling reconstruction of light distribution in multiple dimensions while maintaining compatibility with standard imaging sensors.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If corrective optics are added to correct lens aberrations, then aberration correction is achieved, but bulk, expense and weight of imaging devices increase

Engineering Contradiction:
Improveaberration correctionVSAvoidoptical system structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces physical corrective optics with computational correction methods. By capturing the full light field distribution, the system enables software-based aberration correction, eliminating the need for additional physical corrective lenses and reducing device bulk, weight, and complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the approach from physical parameter modification (adding optical elements) to data parameter processing. By recording complete light field information, the system allows post-processing adjustment of focal planes and correction of aberrations through computational algorithms rather than physical optical modifications.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If the numerical aperture is enlarged to overcome diffraction limits, then spatial resolution is improved, but the lens becomes a half-sphere and practical limits are reached

Engineering Contradiction:
Improvespatial resolutionVSAvoidlens structure
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent transitions from improving resolution through single-dimension lens aperture enlargement to capturing resolution information across multiple dimensions. By recording the full light field including angular distributions, the system achieves super-resolution capabilities through computational reconstruction without requiring physically large lenses.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system performs preliminary capture of all light field information before computational processing. By recording complete light distribution data at the sensor plane, the system enables subsequent computational extraction of high-resolution information, effectively performing resolution enhancement in the data processing stage rather than requiring large physical apertures.

Inventive Principle:
Principle #10Preliminary action

4Area of stationary object

If the stage is moved up and down to examine the entire specimen, then complete specimen imaging is achieved, but the process is slow and may not be possible on live or light-sensitive specimens

Engineering Contradiction:
Improvespecimen coverageVSAvoidimaging time
Core Design Contradiction:
Area of stationary objectVSLoss of time

Solution Approach 1:

The patent adds the depth dimension to the captured light field, enabling simultaneous recording of information from different focal planes. The microlens array captures light rays from multiple depths in a single snapshot, allowing computational reconstruction of complete 3D specimen information without physical stage movement.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system performs preliminary capture of the complete light field including all depth information in a single exposure. This preliminary action records all necessary data for examining the entire specimen, eliminating the need for subsequent stage movements and enabling immediate computational analysis of the complete specimen volume.

Inventive Principle:
Principle #10Preliminary action

5Loss of information

If multiple photographs are taken to capture different perspectives, then complete spatial information is obtained, but the complexity of capturing and processing increases

Engineering Contradiction:
Improvespatial informationVSAvoidcapture and processing system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges multiple perspective-capture functions into a single imaging system. The microlens array simultaneously captures light field information that would otherwise require multiple photographs taken from different positions, consolidating the capture process into one device and one exposure event.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary capture of complete light field information including all angular and depth data in a single photograph. This preliminary action records all spatial information needed for multiple perspectives, eliminating the need for subsequent photographing from different positions and simplifying the overall capture process.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system enhances image quality by enabling focus adjustment and aberration correction, improving spatial resolution and depth of field, allowing for detailed three-dimensional imaging and multiple perspectives without physical movement of the specimen or optics, thus overcoming traditional microscopy limitations.

Implementation Method 1

a microlens array at an intermediate image plane, which detects and processes light rays

Methodology Applied
Scientific EffectLight focusing: Lens

Data Source

PatentUS7723662B2Microscopy arrangements and approaches
Publication Date: 2010.05.25 THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIV
  • US7723662B2 patent drawing
  • US7723662B2 patent drawing
  • US7723662B2 patent drawing

AI summary

Light-field microscopy is facilitated using an approach to image computation. In connection with an example embodiment, a subject (e.g., 105) is imaged by passing light from the subject through a microlens array (e.g., 120) to a photosensor array (e.g., 130) to simultaneously detect light from the subject that is passed through different directions to different locations. In certain embodiments, information from the detected light is used to compute refocused images, perspective images and/or volumetric datasets, from a single-shot photograph.