Structured Illumination Microscope Demodulation Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Structured illumination microscopy faces challenges in achieving high-speed super-resolution imaging due to the need for acquiring and processing multiple modulated images to generate a single super-resolution image, which is time-consuming and inefficient.

Innovation Solution

A structured illumination microscope device that includes a control unit to manage the combination of wave vectors and phases for fringe modulation, an image acquisition system to capture a set of images, and a computing unit to perform demodulation using specific types of images, optimizing the demodulation process to generate super-resolution images efficiently.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple modulated images are acquired and processed to generate super-resolution images, then measurement precision is improved, but productivity deteriorates due to time-consuming acquisition and processing

Engineering Contradiction:
Improvespatial resolutionVSAvoidimage acquisition speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary actions by acquiring a larger set of images than traditionally required, including multiple images with different illumination patterns and phases. This preliminary data collection enables optimized demodulation processing that can generate super-resolution images faster by having redundant information available for more efficient computational processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention implements dynamic image set management where the computing unit selectively uses required M types of images from an image set of consecutive P images. The system dynamically determines which images are needed for demodulation based on the current processing requirements, allowing flexible optimization of processing speed while maintaining image quality.

Inventive Principle:
Principle #15Dynamics

2Measurement precision

If multiple modulated images are acquired and processed to generate super-resolution images, then measurement precision is improved, but loss of time increases due to repeated processing steps

Engineering Contradiction:
Improvespatial resolutionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The invention merges multiple image processing operations into a unified demodulation process. By combining the required M types of images from the image set and processing them simultaneously through optimized demodulation algorithms, the system reduces the total processing time compared to traditional sequential processing of multiple modulated images.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary acquisition of an extended image set that includes all possible images needed for demodulation. This preliminary action ensures that when super-resolution image generation is required, the necessary data is already available, eliminating the need for additional acquisition time during the actual processing phase.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If uniform intensity distribution of fringes is maintained across multiple images, then manufacturing precision is improved, but device complexity increases due to precise control requirements

Engineering Contradiction:
Improveillumination uniformityVSAvoidcontrol system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system implements self-service through computational correction of illumination non-uniformity. Rather than requiring complex hardware controls to maintain perfectly uniform fringe intensity, the invention allows variations in illumination patterns to be captured and then corrects these variations through demodulation processing algorithms, making the control system simpler while maintaining precision.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The optimized demodulation processing enables faster acquisition of high-quality super-resolution images by uniformly controlling the illumination patterns and phases, improving the speed and efficiency of image generation while maintaining high spatial frequency information.

Implementation Method 1

a diffraction grating; a projection optical system that projects light from a light source onto an object to be observed via the diffraction grating

Methodology Applied
Scientific EffectDiffraction: Diffraction

Implementation Method 2

A technique of modulating the spatial frequency of the structure of an object to be observed using illumination light

Methodology Applied
Scientific EffectInterference: Interference

Data Source

PatentUS10067331B2Structured illumination microscope device
Publication Date: 2018.09.04 NIKON CORP
  • US10067331B2 patent drawing
  • US10067331B2 patent drawing
  • US10067331B2 patent drawing

AI summary

A structured illumination microscope device includes acquisition unit that repeats a series of processing steps including controlling a combination of a wave vector and phase of fringes and acquiring N images; and computing unit in which processing for demodulating the image of the sample using a required M types of images from an image set of consecutive P images. The M types of images include: Q types (where Q≥3) of modulated images; and one type of modulated image having the wave vector in common with and the phase differing from at least one among the Q types of modulated images, or one unmodulated image.An arrangement of the N images satisfies the uniformity condition, meaning “intensity distribution of the fringes is spatially uniform when accumulated between the N images” and the refresh condition, meaning “the M types of images are always included in the image set”.