Structured Illumination Microscopy Spatial Frequency Separation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current structured illuminating microscopy methods require acquiring multiple modulated images and generating spectra to achieve super-resolved observations, making high-speed observation challenging due to the complexity and time-consuming nature of the process.

Innovation Solution

The structured illuminating microscopy apparatus employs an illuminating optical system that performs spatial modulation using fringes, an image-forming optical system for modulating image formation, and a calculating unit that separates spatial frequency components from acquired modulated images, allowing for efficient generation of super-resolved images by controlling wave number vectors and phases of the fringes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple modulated images are acquired and spectra are generated to achieve super-resolved observations, then measurement precision is improved, but productivity deteriorates due to the time-consuming process

Engineering Contradiction:
Improvesuper-resolutionVSAvoidobservation speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the spatial frequency spectrum into distinct components (0th-order, ±1st-order, ±2nd-order modulating components) that can be separated and processed independently. By acquiring modulated images at specific phase differences (e.g., 0, 2π/3, 4π/3) and applying Fourier transform, each spectral component can be isolated and recombined to reconstruct super-resolved images, enabling faster processing while maintaining precision

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary spatial modulation of the sample with structured illumination patterns before image acquisition. By pre-modulating the sample with known fringe patterns at different phases, the high-frequency information is encoded into the modulated images in advance, allowing for efficient computational extraction of super-resolved details without requiring multiple sequential acquisitions

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple modulated images are acquired and spectra are generated to achieve super-resolved observations, then measurement precision is improved, but loss of time increases due to the complexity of the process

Engineering Contradiction:
Improvesuper-resolutionVSAvoidtime for acquiring multiple images
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent employs periodic modulation of the illumination pattern with specific phase differences (0, 2π/3, 4π/3) to encode spatial frequency information into a small set of modulated images. By using this periodic phase modulation approach, the system can extract multiple spectral components from fewer images, significantly reducing the time required compared to acquiring many images at different conditions

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent replaces mechanical scanning or sequential image acquisition with computational methods. By using Fourier transform and mathematical separation of spectral components from a limited set of modulated images, the system achieves super-resolution without requiring time-consuming mechanical adjustments or multiple sequential acquisitions, thus reducing time loss

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables faster and more efficient acquisition of super-resolved images by simplifying the process of separating spatial frequency components, thereby improving the speed and accuracy of high-speed observation in microscopy.

Implementation Method 1

an illuminating optical system performing a spatial modulation on a sample by fringes

Methodology Applied
Scientific EffectInterference: Interference

Implementation Method 2

an image-forming optical system performing a modulating image formation of the sample by forming an image of an observational light flux from the sample being performed the spatial modulation

Methodology Applied
Scientific EffectDiffraction: Diffraction

Data Source

PatentUS10261304B2Structured illuminating microscopy apparatus
Publication Date: 2019.04.16 NIKON CORP
  • US10261304B2 patent drawing
  • US10261304B2 patent drawing
  • US10261304B2 patent drawing

AI summary

An acquiring unit of a structured illuminating microscopy apparatus acquires at least two modulated images having the same wave number vector and the different phases; and a calculating unit of the structured illuminating microscopy apparatus, in a spatial frequency spectrum of each of at least the two modulated images acquired by the acquiring unit, separates a 0th-order modulating component and ±first-order modulating components of observational light fluxes superimposed on arbitrary two observation points based on at least four observation values regarding the two observation points which are mutually displaced by an amount of the wave number vector.