Microscope Image Interpolation for Cross-Condition Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current microscope systems face challenges in generating corresponding image data across different observation conditions, leading to gaps in image comparison due to varying resolution and imaging times required by different microscopy techniques.

Innovation Solution

The system employs an image processor that generates corresponding image data by interpolating or reimaging based on microscopic image data from multiple microscopes operating under different conditions, using techniques like Fourier transform and weighted averaging to fill gaps and enhance image comparison.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple microscopy techniques are used to capture images under different observation conditions, then measurement precision and analysis comprehensiveness are improved, but device complexity and data alignment difficulty increase

Engineering Contradiction:
Improveimage comparison accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent introduces an image processing device as an intermediary component that receives image data from multiple microscopes and generates corresponding image data through interpolation. This mediator handles the complexity of aligning and comparing images from different microscopy techniques, resolving the contradiction by centralizing the complex processing task in a dedicated unit rather than requiring complex coordination between multiple microscopes.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates corresponding image data as copies or representations of the original microscopic images. By generating interpolated image data that corresponds to different observation conditions, the system enables comparison without requiring direct access to or coordination between multiple complex microscope systems, thus reducing device complexity while maintaining measurement precision.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If images are captured under different observation conditions with varying resolution and imaging times, then analysis comprehensiveness is improved, but data alignment and comparison difficulty increase

Engineering Contradiction:
Improveobservation condition flexibilityVSAvoidimage alignment difficulty
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies parameter changes by interpolating image data to generate corresponding images at different observation conditions. The image processing device transforms image parameters (resolution, magnification, observation conditions) to create aligned datasets, enabling comparison across different microscopy techniques while maintaining versatility in observation conditions.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent performs preliminary image processing by generating corresponding image data before comparison is needed. By pre-processing the images to align them under common observation conditions, the system eliminates alignment difficulties that would otherwise arise during the comparison phase, making the process more efficient and accurate.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If high resolution images are captured using techniques requiring longer imaging times, then measurement precision is improved, but productivity and efficiency decrease

Engineering Contradiction:
Improveimage resolutionVSAvoidimaging speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent creates corresponding image data as interpolated copies that simulate high-resolution images without requiring the full imaging time of the original high-resolution capture. This allows the system to achieve measurement precision comparable to high-resolution imaging while maintaining the faster imaging speeds of lower-resolution techniques.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent applies partial action by using interpolation to generate sufficient image detail for comparison purposes without performing complete high-resolution imaging. The interpolated image data provides enough precision for the intended application while avoiding the excessive imaging time required for full high-resolution capture, thus balancing precision and productivity.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11442262B2Image processing device, microscope system, image processing method, and program
Publication Date: 2022.09.13 NIKON CORP
  • US11442262B2 patent drawing
  • US11442262B2 patent drawing
  • US11442262B2 patent drawing

AI summary

An image processor includes an image generator configured to generate corresponding image data corresponding to first microscopic image data obtained under a first observation condition, based on second microscopic image data and third microscopic image data obtained under a second observation condition, and an image output unit configured to output the corresponding image data. The corresponding image data may be image data corresponding to a first focal plane from which the first microscopic image data are obtained, and wherein the second microscopic image data and the third microscopic image data may be image data on a second focal plane and a third focal plane, respectively, which are different from the first focal plane.