Image Processing Device for TIRF and Confocal Microscope Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods require manual visual correction and alignment of images from total internal reflection fluorescence microscopes and confocal microscopes, which are challenging due to differences in observation ranges and image characteristics.

Innovation Solution

A system that automatically transforms the coordinate systems of images from total internal reflection fluorescence microscopes and confocal microscopes, allowing for accurate superposition by calculating coordinate transformation coefficients using reference points and applying Helmert transformation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual visual correction is used to superpose images from TIRF and confocal microscopes, then the user can align the images, but the process is time-consuming and requires significant manual effort

Engineering Contradiction:
Improvealignment precisionVSAvoidtime for image correction
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs automatic coordinate transformation and image superposition without requiring manual user intervention. The computer automatically calculates transformation parameters based on coordinate information from both microscopes and executes the superposition, making the system self-sufficient and eliminating time-consuming manual operations.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical process of visual image alignment with an automated computer-based coordinate transformation system. By substituting the manual mechanical adjustment process with algorithmic coordinate calculation and transformation, the system achieves both high precision and time efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If images from TIRF and confocal microscopes are superposed, then comprehensive sample analysis is enabled, but the different observation methods produce images with different coordinate systems that require complex transformation

Engineering Contradiction:
Improvemulti-method image analysisVSAvoidcoordinate transformation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal coordinate transformation system that can handle images from different microscope types (TIRF and confocal). The computer executes the same coordinate transformation algorithm regardless of the source microscope, making the system multi-functional and adaptable to various imaging methods while maintaining simplicity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a standardized coordinate system as an intermediary framework that bridges the different coordinate systems of TIRF and confocal microscopes. By transforming both microscope coordinate systems into this common reference frame, the system simplifies the transformation process and enables easy superposition of images from different sources.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If coordinate transformation is performed manually, then image alignment can be achieved, but the process becomes complicated and error-prone

Engineering Contradiction:
Improvesuperposition accuracyVSAvoidoperation simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically performs coordinate transformation calculations and image superposition without requiring manual user operations. The computer independently processes the coordinate information from both microscopes, calculates the transformation parameters, and executes the superposition, eliminating manual intervention entirely and ensuring both accuracy and simplicity.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical process of coordinate transformation with an automated computer-based calculation system. By substituting manual mathematical transformations with algorithmic processing, the system eliminates human error while maintaining operational simplicity for the user.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP2439576B1Image processing device, program and microscope
Publication Date: 2018.05.16 NIKON CORP
  • EP2439576B1 patent drawingFigure 1
  • EP2439576B1 patent drawingFigure 2
  • EP2439576B1 patent drawingFigure 3

AI summary

The present invention relates to an image processor, a program and a microscope, which enable a TIRF image and a confocal image to be superposed simply and accurately. A reference point detection unit 111 detects, reference points, three or more images respectively from a TIRF image of a predetermined surface of a sample obtained using a total internal reflection fluorescence microscope, and a confocal image of the predetermined surface of the sample obtained using a confocal microscope, the three or more images in the TIRF image respectively corresponding to the three or more images in the confocal image as images of a same position on the predetermined surface of the sample. The coordinate transformation coefficient calculation unit 112 calculates coordinate transformation coefficients for mutually transforming a coordinate system of the reference points in the TIRF image and a coordinate system of the reference points in the confocal image. A superposing unit 113 superposes the TIRF image and the confocal image using the coordinate transformation coefficient. The present invention can be applied to, for example, an image processor which processes an observation image of a microscope.