Microscope Controller Sub-Region Focus Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In microscopy, the narrow depth of field and irregularities in cell tissue samples require multiple focus adjustments when observing digital images, causing inconvenience for operators.

Innovation Solution

An information processing system that divides images into sub-regions, calculates in-focus position information using contrast evaluation, and generates a color distribution map or look-up table to determine in-focus states, allowing for the creation of an entire region in-focus image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If multiple captured image data are taken at different focus positions to capture the entire sample, then the observation completeness is improved, but the operator burden increases due to repeated manual focus adjustments

Engineering Contradiction:
Improveobservation completenessVSAvoidoperator burden
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system performs preliminary automatic focus adjustment before image capture by calculating optimal focus positions based on sample height information. This preliminary action eliminates the need for operators to manually adjust focus repeatedly when observing different regions, as the system has already prepared the correctly focused image for each region.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service by automatically determining the in-focus image for each sub-region without operator intervention. The controller automatically calculates focus positions, selects appropriate images, and generates composite in-focus images, allowing the observation system to serve itself rather than requiring continuous manual focus adjustment.

Inventive Principle:
Principle #25Self-service

2Adaptability or versatility

If manual focus adjustment is performed by operators using mouse wheel or similar input devices, then focus control flexibility is improved, but observation efficiency deteriorates due to time-consuming adjustments

Engineering Contradiction:
Improvefocus control flexibilityVSAvoidobservation efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The system replaces the mechanical manual focus adjustment process with an automated computational system. Instead of using mouse wheels or physical focus mechanisms, the controller automatically calculates optimal focus positions using image contrast evaluation and sample height data, then digitally selects and composes the in-focus images, substituting mechanical operation with automated image processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system changes the focus parameter automatically by calculating the optimal focus position for each sub-region based on image contrast metrics and sample topography. This parameter change is performed computationally rather than mechanically, allowing the system to rapidly adjust focus parameters across multiple regions without the time constraints of manual manipulation.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If the depth of field is increased to reduce focus adjustments, then the ease of operation is improved, but the manufacturing precision of the optical system deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidoptical system precision
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system transitions from a single-plane focus approach to a multi-depth approach by capturing and processing images at multiple focus positions. Instead of trying to increase the depth of field in the optical dimension, the system adds the depth dimension digitally by combining multiple focal planes into a single composite in-focus image, effectively solving the depth of field limitation through dimensional extension.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The system segments the sample into multiple sub-regions and determines the optimal focus position for each segment independently. This segmentation allows the system to maintain high optical precision for each local region while providing ease of operation globally, as each sub-region is automatically focused according to its specific topography rather than requiring a compromise depth of field for the entire field of view.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This system reduces the load associated with focus adjustments and enhances observer convenience by providing an entire image in focus, improving the observation experience.

Implementation Method 1

calculate in-focus position information by which depth position is in a focus state with respect to each sub-region... calculate an evaluation value of contrast; and (b) using the calculated evaluation value, determine which of the plurality of images is in an in-focus state

Methodology Applied
Scientific EffectOptical contrast:

Data Source

PatentEP3709067B1Microscope control device, information processing apparatus, information processing system, method of operating a microscope control device and a non-transitory computer-readable medium
Publication Date: 2023.10.04 SONY GROUP CORP
  • EP3709067B1 patent drawingFigure 1
  • EP3709067B1 patent drawingFigure 2
  • EP3709067B1 patent drawingFigure 3

AI summary

In one example embodiment, a microscope control device comprises a controller configured to store a plurality of images having different depth positions. In one example embodiment, the microscope control device divides the plurality of images into a plurality of sub-regions. In one example embodiment, the microscope control device, for each sub-region, generates in-focus position information which corresponds to a depth position.