Pathology Scanner Frame Warping for Sharp MSIA Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Scanning microscope imaging of large specimens faces challenges with blurring due to geometric distortion and detector array misalignment, which reduces image sharpness and signal-to-noise ratio in Moving Specimen Image Averaging (MSIA) and Time Delay Integration (TDI) techniques.

Innovation Solution

Software-based geometric correction of each image frame to account for optical distortion, combined with warping the detector array pattern to match the optical train's distortion, and alignment correction to minimize blurring and enhance image resolution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple image capture devices are arranged in close proximity to capture images at different magnifications, then the scanning speed and productivity are improved, but the optical system becomes more complex and alignment difficulty increases

Engineering Contradiction:
Improvescanning speedVSAvoidoptical system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The optical system is segmented into multiple independent image capture devices, each with its own objective lens and detector assembly. This allows each device to be optimized independently while working together to capture multiple magnifications simultaneously, resolving the contradiction between productivity improvement and system complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimensional approach by arranging image capture devices at different lateral positions and angles relative to the specimen. This spatial dimensionality allows simultaneous capture of multiple magnifications without requiring complex temporal sequencing, thereby improving scanning speed while managing optical complexity through geometric arrangement

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple image capture devices are used to capture images at different magnifications, then the signal to noise ratio is improved, but the manufacturing precision and alignment difficulty increase

Engineering Contradiction:
Improvesignal to noise ratioVSAvoidalignment precision
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

A synchronized control system acts as an intermediary between multiple image capture devices and the data processing unit. This intermediary coordinates the operation timing, data synchronization, and signal integration across all devices, improving the effective signal-to-noise ratio through coordinated capture while reducing the burden on mechanical alignment precision

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent utilizes parameter changes in the optical path, specifically varying the numerical aperture and focal plane parameters across different image capture devices. By optimizing these optical parameters for each device's specific magnification range, the system achieves improved signal-to-noise ratio while accommodating variations in manufacturing precision through parameter optimization rather than requiring perfect alignment

Inventive Principle:
Principle #35Parameter changes

3Productivity

If multiple image capture devices capture images simultaneously at different magnifications, then the productivity is improved, but the data processing complexity and storage requirements increase

Engineering Contradiction:
Improvescanning speedVSAvoiddata processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-defining region-of-interest areas and magnification levels before scanning begins. This allows the synchronized control system to pre-configure which devices capture images at which magnifications for specific regions, reducing real-time data processing complexity while maintaining high productivity through simultaneous capture

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts and processes only the most relevant data from multiple image capture devices by implementing intelligent filtering and selective transmission of images based on pre-defined criteria. This extraction approach reduces the volume of data requiring full processing and storage, thereby managing data processing complexity while preserving the productivity benefits of simultaneous multi-magnification capture

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the acquisition of sharp, high-resolution MSIA and TDI images by correcting geometric and color distortions, improving signal-to-noise ratio and allowing for efficient stitching of tiles for larger and three-dimensional imaging.

Implementation Method 1

an objective lens of the microscope focuses light from the specimen onto a detector

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

A bandpass filter may be positioned between the light source and the specimen

Methodology Applied
Scientific EffectFilter (optical): Filter (optical)

Data Source

PatentEP3278167B1High resolution pathology scanner with improved signal to noise ratio
Publication Date: 2023.09.06 HURON TECH INT INC
  • EP3278167B1 patent drawingFigure 1A
  • EP3278167B1 patent drawingFigure 1B
  • EP3278167B1 patent drawingFigure 2A

AI summary

An instrument for imaging a specimen or a portion of a specimen is configured to capture multiple image frames of the portion of the specimen being scanned using Moving Specimen Image Average (MSIA) to create one or more image strips. The instrument is configured to use an active area of a two dimensional sensor array that covers substantially all of the width of the sensor array but less than a length. The one or more image strips are created from the multiple image frames as each of the multiple image frames is captured. Preferably, the instrument is configured to remove blurring, caused by distortion of the optics, by software or by warping a grid of the two dimensional detector array, including TDI array.