Optical Microscope Distortion Correction via Luminance Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Optical microscopes often produce images with complicated distortion due to their complex magnifying systems, making it difficult to correct using existing methods based on distance from the distortion center, especially when high-magnification images need to be stitched together accurately.

Innovation Solution

An information processing apparatus that uses a calibration pattern with regularly changing luminance to determine correction points, calculates a distortion vector field, and removes translation and rotational components to achieve high-accuracy distortion correction, storing correction vectors for efficient future use.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If distortion correction is performed using an expression based on distance from the distortion center, then simple lens distortion can be corrected, but complicated distortion from optical microscope systems cannot be corrected accurately

Engineering Contradiction:
Improvedistortion correction accuracyVSAvoidapplicability to different distortion types
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a correction image by capturing an actual calibration pattern through the optical microscope system, thereby copying the real distortion characteristics present in the system. This correction image serves as a template that accurately represents the specific distortion pattern, allowing for precise correction of that particular distortion type without relying on generic mathematical models

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms the distortion correction approach from using mathematical parameters (distance from center expressions) to using image-based parameters (luminance distributions and correlation values). By changing from analytical parameters to empirical image parameters, the system can accurately correct complicated distortions that cannot be described by simple geometric models

Inventive Principle:
Principle #35Parameter changes

2Area of stationary object

If high-magnification images are stitched together, then larger field of view is achieved, but distortion correction becomes more critical and difficult

Engineering Contradiction:
Improvefield of viewVSAvoidstitching accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent captures correction images of calibration patterns at the same magnification and field of view settings used for actual imaging. This creates accurate copies of the distortion characteristics specific to each magnification level, enabling precise correction that maintains stitching accuracy when combining multiple high-magnification images into a larger field of view

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs distortion correction in advance by creating correction images and correction data before actual imaging. This preliminary correction setup allows subsequent high-magnification images to be stitched together with high accuracy, as the distortion characteristics have already been characterized and compensated for in the correction data

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If correction data is stored for each imaging condition, then correction accuracy is improved, but data storage requirements and processing time increase

Engineering Contradiction:
Improvecorrection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent creates compact correction images that serve as compressed representations of distortion characteristics. These correction images can be stored efficiently and quickly processed through correlation operations, achieving both high correction accuracy and fast processing by avoiding the need to store and process large amounts of raw calibration data for each imaging condition

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms complex distortion correction data into simplified luminance distribution patterns that can be rapidly compared using correlation operations. By changing from storing detailed correction maps to storing compact luminance patterns, the system reduces storage requirements and accelerates the matching process while maintaining correction accuracy

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9124775B2Information processing apparatus, information processing method, program, and imaging apparatus including optical microscope
Publication Date: 2015.09.01 SONY GROUP CORP
  • US9124775B2 patent drawing
  • US9124775B2 patent drawing
  • US9124775B2 patent drawing

AI summary

An information processing apparatus is provided and includes: a first storage section to store coordinates of luminance change points in a calibration pattern having a luminance distribution in two axis directions orthogonal to each other; a generation section to generate standard pattern information on a luminance distribution of a calibration image; a determination section to determine coordinates of a luminance change point of the calibration image, as coordinates of a correction luminance change point; a first calculation section to calculate a difference between the stored coordinates of the luminance change points and the coordinates of the correction luminance change points, as a distortion vector field; a second calculation section to calculate a component obtained by removing a translation component and a rotational component from the distortion vector field, as a correction vector field; and a correction section to correct an image captured by the imaging section by using the calculated correction vector field.