Holographic Video Microscopy for Real-Time Particle Characterization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for characterizing colloidal particles, such as spheres, using holographic imaging are inefficient and unable to perform real-time analysis or certain characterizations like bead-based molecular binding assays and flow field measurements due to difficulties in interpreting holographic images and requiring fluorescent labeling.

Innovation Solution

Implementing a holographic video microscopy system that uses coherent illumination and the Lorenz-Mie theory for image analysis, combined with GPU-accelerated processing and a simplified Hough transform, to enable automated, real-time characterization of colloidal particles by fitting scattering patterns and determining their position, radius, and refractive index.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Length of stationary object

If coherent illumination is used for holographic imaging, then working distance and depth of focus are extended, but image interpretation becomes difficult and real-time analysis cannot be performed

Engineering Contradiction:
Improveworking distanceVSAvoidreal-time analysis capability
Core Design Contradiction:
Length of stationary objectVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing lookup tables of scattering patterns for various particle sizes and refractive indices. During real-time analysis, these pre-computed patterns are matched against observed holographic images to quickly determine particle characteristics, enabling real-time analysis without complex computational fitting procedures.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses copying by creating digital copies of standard scattering patterns from Lorenz-Mie theory calculations and storing them in lookup tables. These digital copies are then compared with actual particle images to identify particle properties, replacing complex real-time computational modeling with rapid pattern matching.

Inventive Principle:
Principle #26Copying

2Productivity

If conventional imaging methods are used, then real-time analysis can be performed, but working distance and depth of focus are limited

Engineering Contradiction:
Improvereal-time analysis capabilityVSAvoidworking distance
Core Design Contradiction:
ProductivityVSLength of stationary object

Solution Approach 1:

The patent replaces conventional mechanical imaging systems with a holographic system that uses coherent light to create interference patterns. This substitution enables extended working distance and depth of focus while maintaining real-time analysis capability through digital processing of holographic images.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If fluorescent labeling is used for molecular binding assays, then bead-based assays can be performed, but artifacts from non-specific binding and bleaching occur

Engineering Contradiction:
Improvemolecular binding assay capabilityVSAvoidassay accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent extracts and eliminates the fluorescent labeling step from the molecular binding assay protocol. By using holographic imaging to directly detect and characterize particles based on their scattering properties, the method removes the source of artifacts (non-specific binding and bleaching) associated with fluorescent tags while maintaining assay functionality.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies self-service by enabling particles to serve as their own markers through their inherent light scattering properties. The holographic imaging system detects and characterizes particles based on their natural optical properties rather than requiring external fluorescent labels, eliminating artifacts from labeling processes.

Inventive Principle:
Principle #25Self-service

4Measurement precision

If phenomenological models are used for scattering patterns, then tracking resolution is achieved, but the methods are inefficient and cannot perform multiple characterizations

Engineering Contradiction:
Improvetracking resolutionVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent changes the approach from phenomenological models to physics-based Lorenz-Mie theory calculations. By using accurate physical models of light scattering and pre-computing lookup tables, the system achieves both high tracking resolution and improved processing efficiency through rapid pattern matching, enabling multiple characterizations simultaneously.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for accurate and efficient real-time characterization of colloidal particles, enabling commercially viable applications such as particle image velocimetry and molecular binding assays without the need for fluorescent labeling, with improved processing speed and precision.

Implementation Method 1

coherent illumination traditionally has not been used widely for particle image velocimetry because the resulting holographic images can be difficult to interpret quantitatively

Methodology Applied
Scientific EffectLight scattering: Scattering

Implementation Method 2

holographic video microscopy images of colloidal particles can be used to locate the particles' centers in three dimensions

Methodology Applied
Scientific EffectHolography: Interference

Implementation Method 3

using coherent illumination and the Lorenz-Mie theory for image analysis, combined with GPU-accelerated processing

Methodology Applied
Scientific EffectLorenz-Mie scattering theory: Scattering

Data Source

PatentUS11892390B2Automated real-time particle characterization and three-dimensional velocimetry with holographic video microscopy
Publication Date: 2024.02.06 NEW YORK UNIV
  • US11892390B2 patent drawing
  • US11892390B2 patent drawing
  • US11892390B2 patent drawing

AI summary

An in-line holographic microscope can be used to analyze on a frame-by-frame basis a video stream to track individual colloidal particles' three-dimensional motions. The system and method can provide real time nanometer resolution, and simultaneously measure particle sizes and refractive indexes. Through a combination of applying a combination of Lorenz-Mie analysis with selected hardware and software methods, this analysis can be carried out in near real time. An efficient particle identification methodology automates initial position estimation with sufficient accuracy to enable unattended holographic tracking and characterization.