Microscopy System Text Region Rectification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern microscopes often produce overview images where text on sample carriers is mirror-reversed due to calibration transformations, leading to poor legibility, especially when the overview camera views the sample from an oblique angle or captures text on transparent carriers.

Innovation Solution

A computer-implemented method and microscopy system that transforms raw overview images using calibration data to align image directions with fixed directions, while specifically modifying text regions to correct geometric properties such as mirroring, rotation, and perspective distortion, ensuring text is easily readable and correctly oriented.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If calibration transformation is applied to align image directions with fixed directions, then navigation accuracy is improved, but text legibility deteriorates due to mirror-reversal

Engineering Contradiction:
Improvenavigation accuracyVSAvoidtext legibility
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The image processing is segmented into two independent parts: (1) calibration transformation applied to the entire overview image for navigation alignment, and (2) separate text region detection and correction applied specifically to text areas. This allows different transformations to be applied to different parts of the image, resolving the contradiction between navigation accuracy and text legibility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different quality requirements are applied to different regions of the image. The overview image undergoes full calibration transformation for navigation accuracy, while only text regions undergo additional geometric correction. This local differentiation ensures that text legibility is improved without compromising the overall navigation functionality.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If overview camera views sample from oblique angle to capture comprehensive sample carrier, then overview coverage is improved, but text orientation deteriorates due to perspective distortion

Engineering Contradiction:
Improveoverview coverageVSAvoidtext orientation
Core Design Contradiction:
Area of stationary objectVSShape

Solution Approach 1:

The system performs preliminary calibration to determine the oblique viewing geometry, then uses this information to pre-calculate the specific geometric transformation needed for text correction. By preparing the correction parameters in advance based on the known camera angle, the system can efficiently correct text orientation without needing to reposition the camera.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a corrected copy of the text region with proper orientation by applying inverse perspective transformation. Instead of changing the camera angle, it generates a virtual corrected view of the text that appears properly oriented, while the original oblique overview image remains intact for navigation purposes.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20230245360A1Microscopy System and Method for Editing Overview Images
Publication Date: 2023.08.03 CARL ZEISS MICROSCOPY GMBH
  • US20230245360A1 patent drawing
  • US20230245360A1 patent drawing
  • US20230245360A1 patent drawing

AI summary

In a computer-implemented method for editing overview images of a microscope, a raw overview image is obtained in a first step. The raw overview image is transformed by means of calibration data into an overview image in which image directions coincide with given directions. At least one geometric property of text of at least one text region in the overview image is determined. A transformed text region is calculated taking into account the determined geometric property so that the transformed text region exhibits a desired geometric property of the text.