Microscope Display Segmentation for Super-Resolution Preview

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current microscope systems face challenges in obtaining desired super-resolution images due to difficulties in determining the appropriate viewing field and imaging parameters, leading to inefficiencies and repeated imaging attempts, which can degrade the fluorescence intensity of fluorescent dye molecules.

Innovation Solution

A method is introduced that includes a display unit with separate regions for displaying live images and preview images, allowing users to predict the contents of the super-resolution image before construction, thereby optimizing imaging conditions and reducing the time required to obtain a desired super-resolution image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple imaging attempts are performed to obtain a desired super-resolution image, then the probability of obtaining a satisfactory image increases, but the fluorescence intensity of fluorescent dye molecules attenuates due to repeated light irradiation

Engineering Contradiction:
Improveprobability of obtaining desired super-resolution imageVSAvoidfluorescence intensity attenuation
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The system generates a preview image before constructing the final super-resolution image by extracting luminous point information from sequentially captured first images. This preliminary visualization allows users to determine whether the captured images are suitable for super-resolution construction, preventing unnecessary repeated imaging attempts that would further attenuate fluorescence intensity.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If users determine viewing field and imaging parameters through trial and error, then the ability to obtain desired super-resolution images improves, but the time required for imaging increases

Engineering Contradiction:
Improveability to obtain desired super-resolution imageVSAvoidtime required for imaging
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system provides real-time feedback by displaying a preview image generated from captured images before final super-resolution construction. Users can immediately see whether the captured images contain sufficient luminous points and whether the viewing field is appropriate, enabling informed decisions about parameter adjustment without waiting for final image construction or requiring multiple trial attempts.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If users repeatedly adjust imaging parameters and re-image, then the quality of super-resolution images improves, but the total imaging time increases

Engineering Contradiction:
Improvequality of super-resolution imageVSAvoidtotal imaging time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The preview image generation performs preliminary quality assessment of captured images by extracting and visualizing luminous point information. This allows users to determine image suitability before committing to time-consuming super-resolution construction, preventing wasted time on unsuitable images and reducing the need for repeated imaging cycles.

Inventive Principle:
Principle #10Preliminary action

4Device complexity

If the system displays only the final super-resolution image, then the simplicity of the display interface is maintained, but the user's ability to predict and control image construction is reduced

Engineering Contradiction:
Improvesimplicity of display interfaceVSAvoiduser's ability to predict and control image construction
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The display interface is segmented into two distinct regions: a first display region showing preview images generated from captured data, and a second display region showing the final super-resolution image. This segmentation allows users to separately examine the preliminary captured images and the constructed super-resolution image, providing predictive capability and control while maintaining interface organization and clarity.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables easier and more efficient acquisition of desired super-resolution images by allowing users to confirm and adjust imaging conditions before constructing the final image, thereby reducing the time and effort needed to achieve a suitable super-resolution image.

Implementation Method 1

in the case where the super-resolution image is constructed using images of fluorescence emitted from fluorescent dye molecules used to observe the sample

Methodology Applied
Scientific EffectFluorescence: Fluorescence

Data Source

PatentEP3629070B1Method of controlling microscope system, microscope system, and recording medium
Publication Date: 2024.11.13 SYSMEX CORP
  • EP3629070B1 patent drawingFigure 1
  • EP3629070B1 patent drawingFigure 2A~2B
  • EP3629070B1 patent drawingFigure 3

AI summary

A method according to one or more aspects may control a microscope system including an imaging unit configured to image a sample, and a display unit including a first display region and a second display region. The method may include: sequentially displaying, in the first display region, first images sequentially captured by the imaging unit; and displaying, in the second display region, a second image generated based on information extracted from the sequentially captured first images.