SIM Sub-Tile Calibration for Optical Distortion Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing structured illumination microscopy (SIM) systems face challenges in ensuring high-quality raw images for successful reconstruction, particularly in imaging biological samples like nucleotide sequences, due to the need for careful tuning and calibration of imaging optics and associated optical components.

Innovation Solution

A method and apparatus for processing SIM images by defining a smaller window within each image, capturing sub-tiles, estimating parameters such as modulation, angle, spacing, and phase deviation, and generating a distortion model to adjust data for high-resolution imaging, using a processor to store and validate these parameters in a predetermined format.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional SIM imaging is used to capture images of biological samples, then the imaging process can be performed, but the image quality is insufficient for successful reconstruction due to optical distortions and the need for careful tuning and calibration

Engineering Contradiction:
Improveimage qualityVSAvoidoptics calibration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary action by capturing a calibration dataset before actual imaging to pre-determine distortion parameters. The processor analyzes this calibration data to establish distortion models that are then applied during reconstruction, eliminating the need for complex real-time optics calibration and ensuring high image quality from the start

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary calibration dataset and distortion model that mediates between the raw captured images and the final reconstructed images. This intermediary layer of calibration data serves as a reference to correct optical distortions, improving measurement precision without requiring complex manual optics tuning

Inventive Principle:
Principle #24Intermediary (Mediator)

2Area of stationary object

If the full field of view is used for image reconstruction, then the coverage area is maximized, but optical distortions affect the entire image reducing reconstruction quality

Engineering Contradiction:
Improvefield of view coverageVSAvoidreconstruction accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system applies segmentation by dividing the full field of view into multiple sub-regions or tiles. Each sub-region is processed individually with its own distortion parameters derived from the calibration dataset. This allows the entire field of view to be imaged while maintaining high reconstruction accuracy in each local region by accounting for position-specific optical distortions

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If multiple calibration parameters are estimated for each sub-tile, then the distortion correction accuracy is improved, but the data processing time and computational complexity increase

Engineering Contradiction:
Improvedistortion correction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-estimating distortion parameters for all sub-tiles during the calibration phase before actual imaging. This pre-computation stores distortion models that can be rapidly applied during reconstruction without requiring time-consuming real-time calculations, thus improving correction accuracy while minimizing processing time loss

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent maintains continuity of useful action by establishing a continuous distortion model across all sub-tiles based on the calibration dataset. Once the calibration is performed, the distortion correction can be continuously and efficiently applied to all subsequent images without repeated complex calculations, reducing processing time while maintaining high accuracy

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentEP3931618B1Apparatus and method of estimating values from images
Publication Date: 2025.07.02 ILLUMINA INC
  • EP3931618B1 patent drawingFigure 1Aa~1Ab
  • EP3931618B1 patent drawingFigure 1B
  • EP3931618B1 patent drawingFigure 1C

AI summary

A method is used to generate a distortion model for a structured illumination microscopy (SIM) optical system. A sliding window is moved in relation to a plurality of images to define a plurality of sub-tiles. Each sub-tile represents a portion of the corresponding image. Parameters are estimated for each sub-tiles. The parameters include two or more parameters selected from the group consisting of modulation, angle, spacing, phase offset, and phase deviation. A full width at half maximum (FWHM) value associated with each sub-tile is estimated. A distortion model is estimated, based at least in part on a combination of the estimated parameters and FWHM values stored in the predetermined format and an estimated center window parameter. A two-dimensional image may be generated, based at least in part on the estimated distortion model. The two-dimensional image may include representations indicating where distortions occur in the optical system.