Stereo 3D Imaging System Using Beam Splitter for Fast Depth Measurement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D imaging technologies face challenges in achieving ultrafast imaging speeds, accurately measuring depth information, and operating under harsh conditions, particularly in multimodal nonlinear spectroscopic microscopy, which requires multiple views and is time-consuming and dose-sensitive.

Innovation Solution

A high-speed stereo 3D multimodal imaging system that uses a beam splitter and adjustable plane mirrors to split near-infrared femtosecond pulsed laser beams, combined with a computer stereo algorithm and a large area array detector, allowing for one measurement to obtain 3D stereo depth information without rotating the sample, and enabling flexible angle differences between views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If computed tomography is used for 3D imaging by rotating the sample at multiple angles, then 3D image reconstruction can be achieved, but the imaging process becomes time-consuming and requires hundreds of views

Engineering Contradiction:
Improve3D image reconstruction accuracyVSAvoidimaging time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent divides the single laser beam into two separate sub-beams with different incident angles using a beam splitter. Each sub-beam provides a different viewing angle of the sample, enabling 3D reconstruction from only two views instead of hundreds of rotated views, thus dramatically reducing imaging time while maintaining 3D reconstruction accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from temporal multiplexing (rotating sample through multiple angles over time) to spatial multiplexing (simultaneous illumination from two different angles). By introducing a spatial dimension with the beam splitter, the system achieves 3D imaging information from two concurrent measurements rather than sequential rotations, resolving the time-loss problem

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple rotations of the sample are performed to obtain full set of 2D projections, then 3D image can be recombined, but huge time and large-dose irradiation are required

Engineering Contradiction:
Improve3D image qualityVSAvoidlaser irradiation dose
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the single laser beam into two sub-beams that simultaneously illuminate the sample from different angles. This allows obtaining 3D imaging information from only two measurements instead of hundreds of rotated views, significantly reducing the total laser irradiation dose while maintaining sufficient 3D image quality

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges the functions of multiple sequential measurements into a single simultaneous measurement. By using the beam splitter to direct two sub-beams at different angles onto the sample at the same time, the system combines multiple viewing angles into one experimental step, reducing both time and energy consumption

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If binocular parallax processing is used for rapid 3D perception, then 3D perception effect can be achieved, but quantitative depth information is not provided

Engineering Contradiction:
Improveimaging speedVSAvoiddepth measurement accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent replaces physiological 3D perception mechanisms with an optical measurement system. By using a beam splitter to create two sub-beams at controlled angles and capturing their respective projections, the system enables quantitative depth measurement through geometric optics and stereo vision algorithms, achieving both speed and precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Manufacturing precision

If ptychotomography is used for ultra-high resolution 3D imaging, then imaging resolution can be improved, but a large number of identical samples and large amount of data are required

Engineering Contradiction:
Improveimaging resolutionVSAvoidnumber of samples
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent segments the illumination path into two distinct sub-beams with different incident angles. This segmentation allows the system to obtain 3D imaging information from only two measurements rather than requiring numerous identical samples, reducing the quantity of samples needed while maintaining ultra-high resolution capability

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach significantly reduces observation time, allows for accurate quantitative depth measurement, and enhances imaging speed and flexibility, making it suitable for imaging ultrafast processes and dose-sensitive samples with improved structural information capture.

Implementation Method 1

a beam splitter, configured to generate first and second near-infrared femtosecond pulsed laser sub-beams with different angles

Methodology Applied
Scientific EffectBeam splitting:

Implementation Method 2

a pair of plane mirrors with adjustable rotation angles, respectively configured to reflect first and second near-infrared ultrafast pulsed laser sub-beams

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 3

a tight focus lens, configured to tightly focus the first and the second near-infrared femtosecond pulsed laser sub-beams onto a 3D micro-nanoscale sample

Methodology Applied
Scientific EffectFocusing: Focusing

Implementation Method 4

a multiphoton spectroscopic microscopy technology based on Coherent anti-Stokes Raman Scattering (CARS) is a powerful tool to observe the microscopic world

Methodology Applied
Scientific EffectCoherent anti-Stokes Raman scattering:

Implementation Method 5

CARS can simultaneously combine other modal nonlinear spectra (e.g., two-photon excited fluorescence (TPEF), second harmonic generation (SHG), third harmonic generation (THG))

Methodology Applied
Scientific EffectTwo-photon excited fluorescence:

Implementation Method 6

CARS can simultaneously combine other modal nonlinear spectra (e.g., two-photon excited fluorescence (TPEF), second harmonic generation (SHG), third harmonic generation (THG))

Methodology Applied
Scientific EffectSecond harmonic generation: Second Harmonic Generation

Implementation Method 7

CARS can simultaneously combine other modal nonlinear spectra (e.g., two-photon excited fluorescence (TPEF), second harmonic generation (SHG), third harmonic generation (THG))

Methodology Applied
Scientific EffectThird harmonic generation:

Implementation Method 8

an imaging lens, configured to collect multimodal nonlinear spectral signals generated by the sample due to scattering

Methodology Applied
Scientific EffectLight collection and imaging:

Implementation Method 9

a large area array detector, configured to simultaneously detect the two 2D images

Methodology Applied
Scientific EffectPhotoelectric detection: Photoelectric Effect

Data Source

PatentUS11880027B2High-speed stereo 3D multimodal imaging system and method
Publication Date: 2024.01.23 HUAZHONG UNIV OF SCI & TECH
  • US11880027B2 patent drawing
  • US11880027B2 patent drawing

AI summary

A high-speed stereo 3D multimodal imaging system including a beam splitter, a pair of mirrors, a tight focus lens, a microscope stage, an imaging lens, a large area array detector, and a true 3D imaging module is provided. The beam splitter is configured to generate near-infrared ultrafast pulsed laser sub-beams with different angles. The mirrors respectively reflect the beams. The tight focus lens tightly focuses the beams onto a 3D micro-nanoscale sample, which can be carried and three-dimensionally displaced by the microscope stage. The imaging lens collects signals generated due to scattering of the tightly focused beams that are irradiated onto the sample so as to obtain two 2D images. The large area array detector simultaneously detects the two 2D images so that the true 3D imaging module can perform a true 3D imaging according to the detected 2D images. A high-speed stereo 3D multimodal imaging method is also provided.