Microscope Surface Image Generation from Point Cloud Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current super-resolution microscopes, such as STORMs and PALMs, face challenges in effectively processing and displaying complex surface information from point cloud data generated from fluorescent substances, limiting their ability to provide detailed, high-resolution images of samples.

Innovation Solution

An information processing device and method that generates surface information from point cloud data using multiple parameters, allowing for the display of multiple surface images based on these parameters, and integrates with a microscope system to capture and process fluorescent images, enabling the generation of high-resolution images by calculating position information and generating point cloud data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple surface images are generated and displayed using multiple parameter values, then the detail and resolution of surface information visualization is improved, but the device complexity and computational load increase

Engineering Contradiction:
Improvesurface information detailVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the complex task of surface visualization into multiple independent parameter variations. Each parameter (first parameter and second parameter) is varied independently to generate separate surface images, allowing the system to break down the complex 3D surface representation into manageable 2D projections with different parameter settings. This segmentation enables detailed analysis without requiring all parameters to be processed simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent adds a new dimension to the visualization by generating multiple surface images from the same point cloud data but with different parameter values. Instead of trying to display all surface information in a single complex 3D view, the system creates multiple 2D surface images that represent different parameter configurations, allowing observers to analyze surface characteristics from multiple dimensional perspectives.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If multiple surface images are displayed in an arranged manner, then the comprehensiveness of information presentation is improved, but the ease of operation and interpretation becomes more difficult

Engineering Contradiction:
Improveinformation completenessVSAvoidimage interpretation difficulty
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent segments the comprehensive surface information into multiple discrete surface images, each representing a specific parameter configuration. By dividing the complete surface data set into separate visual representations based on different first and second parameter values, the system preserves all information while making it accessible in manageable, comparable units that can be arranged and analyzed systematically.

Inventive Principle:
Principle #1Segmentation

3Manufacturing precision

If surface information is generated from point cloud data using multiple parameter values, then the manufacturing precision of surface reconstruction is improved, but the productivity and processing speed decreases

Engineering Contradiction:
Improvesurface reconstruction accuracyVSAvoidimage generation speed
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent performs preliminary action by generating all necessary surface images from the point cloud data in advance, using multiple parameter values. The system pre-processes the 3D surface information into multiple 2D surface representations with different parameter settings, so that when visualization or analysis is needed, the processed images are already available. This preliminary processing enables high precision reconstruction while managing the computational workload efficiently.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of detailed, high-resolution surface images from point cloud data, improving the capability of microscopes to analyze samples with enhanced precision and visualization.

Implementation Method 1

an illumination optical system which irradiates an excitation light to excite a fluorescent substance contained in a sample

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Implementation Method 2

an optical system which irradiates activation light for activating a part of a fluorescent substance contained in a sample

Methodology Applied
Scientific EffectFluorescence activation: Fluorescence

Data Source

PatentUS11428920B2Information processing device, information processing method, information processing program, and microscope for displaying a plurality of surface images
Publication Date: 2022.08.30 NIKON CORP
  • US11428920B2 patent drawing
  • US11428920B2 patent drawing
  • US11428920B2 patent drawing

AI summary

An information processing device comprises: an image processor which generates surface information from point cloud data generated on the basis of position information of an object, using a value of a first parameter and a value of a second parameter; and a display controller which causes a display to display a surface image on the basis of the generated surface information, wherein the image processor generates a plurality of pieces of surface information, using a plurality of values of the first parameter and a plurality of values of the second parameter, and the display controller causes the display to display a plurality of surface images on the basis of the plurality of pieces of generated surface information.