3D Laser Scanning Microscope with Virtual Reality Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D laser scanning microscopes face challenges in efficiently analyzing biological samples due to lengthy measurement times, difficulty in orienting complex structures, and the need for fast decision-making, especially when samples have a short lifespan or undergo rapid physiological changes.

Innovation Solution

A method that integrates a 3D laser scanning microscope with a 3D virtual reality device for real-time interaction, allowing users to navigate and select measurement points in a virtual space that corresponds to the physical space, enabling faster and more accurate data interpretation and interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If conventional 2D projection display is used for 3D measurement data, then device complexity is reduced, but information perception speed and decision-making efficiency deteriorate

Engineering Contradiction:
Improvedisplay system complexityVSAvoidinformation perception speed
Core Design Contradiction:
Device complexityVSSpeed

Solution Approach 1:

The patent transitions from 2D projection display to 3D stereoscopic display, adding a spatial dimension to the visualization. This allows researchers to perceive depth and spatial relationships directly, dramatically improving information perception speed and decision-making efficiency without significantly increasing overall system complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent creates a virtual 3D copy of the physical sample that can be manipulated and viewed from different angles. This virtual replica allows fast perception and decision-making without physically moving the sample, resolving the contradiction between display complexity and information access speed

Inventive Principle:
Principle #26Copying

2Speed

If stereoscopic display is used for 3D data visualization, then information perception speed is improved, but the separation between measurement and interaction increases

Engineering Contradiction:
Improveinformation perception speedVSAvoidtime delay between measurement and interaction
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent implements real-time feedback by linking the stereoscopic display directly to the measurement system. As the laser scans the sample, the 3D image updates continuously, allowing immediate visual feedback and instant interaction decisions without temporal separation between measurement and observation

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent merges the measurement function and visualization function into a unified system. The stereoscopic display is integrated with the laser scanning microscope, combining data acquisition and real-time 3D visualization into a single coordinated system that eliminates delays

Inventive Principle:
Principle #5Merging (Combining)

3Speed

If laser beam deflection is used for 3D scanning instead of sample stage movement, then measurement speed is improved, but device complexity increases

Engineering Contradiction:
Improvescanning speedVSAvoidbeam deflection system complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical sample stage movement system with an optical beam deflection system using galvanometric mirrors. This substitution dramatically increases scanning speed by eliminating mechanical inertia and friction, accepting increased optical system complexity as a worthwhile trade-off for speed improvement

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Measurement precision

If comprehensive 3D scanning of complex biological structures is performed, then measurement precision is improved, but measurement time increases

Engineering Contradiction:
Improve3D structure analysis precisionVSAvoidmeasurement time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary low-resolution scanning to identify regions of interest, then focuses high-resolution scanning only on those specific areas. This preliminary action approach maintains measurement precision for critical structures while dramatically reducing overall measurement time by avoiding comprehensive high-res scanning of entire complex samples

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the speed and accuracy of data interpretation and interaction by providing a natural 3D viewing experience, allowing for faster selection of measurement points and reduced measurement times, even with lower signal-to-noise ratio images, and enables real-time feedback and control over the scanning process.

Implementation Method 1

Two-photon laser scanning microscopes use a laser light of lower energy of which two photons are needed to excite a flourophore in a quantum event, resulting in the emission of a fluorescence photon

Methodology Applied
Scientific EffectTwo-photon absorption: Absorption (EM radiation)

Implementation Method 2

two photons are needed to excite a flourophore in a quantum event, resulting in the emission of a fluorescence photon, which is then detected by a detector

Methodology Applied
Scientific EffectFluorescence emission: Fluorescence

Implementation Method 3

via deflecting mirrors mounted on galvanometric scanners

Methodology Applied
Scientific EffectGalvanometer deflection: Galvanometer

Implementation Method 4

by displacing the objective along its optical axis (Z axis) e.g. via a piezo-positioner to change the depth of the focal plane

Methodology Applied
Scientific EffectPiezoelectric displacement: Piezoelectric Effect

Data Source

PatentEP2798443B1Method for the 3-dimensional measurement of a sample with a measuring system comprising a laser scanning microscope and such measuring system
Publication Date: 2018.12.19 FEMTONICS
  • EP2798443B1 patent drawingFigure 1
  • EP2798443B1 patent drawingFigure 2a
  • EP2798443B1 patent drawingFigure 2b

AI summary

The invention relates to a method for the 3-dimensional measurement of a sample with a measuring system having a 3-dimensional measuring space and comprising a laser scanning microscope, characterised by - providing the measuring system with a 3-dimensional virtual reality device, - creating the 3-dimensional virtual space of the measuring space using the 3-dimensional virtual reality device, - allowing for selecting an operation in the virtual space, - providing real-time unidirectional or bidirectional connection between the measuring space and the virtual space such that an operation selected in the virtual space is performed in the measuring space and data measured in the measuring space is displayed in the virtual space. The invention further relates to a measuring system for the 3-dimensional measurement of a sample, the measuring system having a 3-dimensional measuring space and comprising a laser scanning microscope, characterised by further comprising a 3-dimensional virtual reality device for displaying a 3- dimensional virtual space of the measuring space, and a real-time unidirectional or bidirectional connection is provided between the laser scanning microscope and the 3-dimensional virtual reality device.