Microscope Image Stitching via Target-Aware Region Sequencing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing microscope systems face challenges in accurately combining a large number of partial images to achieve high-resolution, wide-visual-field microscope observation images, with errors occurring due to insufficient combining accuracy and the need for precise position matching.

Innovation Solution

An information processing device that analyzes the presence of an observation target in multiple image regions, controls imaging to prioritize regions with higher likelihood of target presence, and adjusts likelihood levels to minimize errors in combining partial images, thereby improving the accuracy of image stitching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the number of partial images is increased to achieve high-resolution wide-visual-field imaging, then the resolution and field of view are improved, but the combining error increases and combining accuracy deteriorates

Engineering Contradiction:
ImproveresolutionVSAvoidcombining accuracy
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by performing image analysis on the entire image before partial image acquisition to determine which regions contain observation targets. This allows the system to pre-plan the imaging sequence, ensuring that partial images are acquired in an optimal order that minimizes combining errors while covering all regions with targets.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by using the results of image analysis (detection of observation targets in different regions) to dynamically adjust and determine the imaging sequence. The combining accuracy is continuously optimized based on feedback from target detection results, allowing the system to adapt the acquisition order to minimize combining errors.

Inventive Principle:
Principle #23Feedback

2Manufacturing precision

If matching processing is performed in overlapping regions to reduce combining error, then the combining accuracy is improved, but the processing time increases and productivity decreases

Engineering Contradiction:
Improvecombining accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent extracts and processes only the essential information needed for accurate combining - specifically, it performs matching processing only in overlapping regions between adjacent partial images in the imaging sequence, rather than performing exhaustive matching across all possible image pairs. This selective approach reduces processing time while maintaining combining accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary image analysis to identify regions with observation targets before acquisition, which allows the system to pre-determine an optimal imaging sequence. This preliminary planning reduces the need for extensive post-acquisition matching processing, thereby reducing processing time while maintaining combining accuracy.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If all regions are imaged with high magnification to ensure no target is missed, then the detection reliability is improved, but the imaging time and processing time increase

Engineering Contradiction:
Improvedetection reliabilityVSAvoidimaging time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies partial action by performing high-magnification imaging only on regions that are determined to contain observation targets, rather than imaging all regions uniformly. The image analysis step identifies which regions require detailed imaging, allowing the system to apply excessive imaging (high magnification) selectively only where necessary to maintain detection reliability.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent performs preliminary low-magnification imaging and image analysis to identify regions containing observation targets before performing high-magnification imaging. This preliminary action allows the system to plan the high-magnification imaging sequence in advance, ensuring no target is missed while minimizing the total imaging time by avoiding unnecessary high-magnification imaging in empty regions.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11307399B2Information processing device, information processing method, program, and microscope system
Publication Date: 2022.04.19 SONY GROUP CORP
  • US11307399B2 patent drawing
  • US11307399B2 patent drawing
  • US11307399B2 patent drawing

AI summary

Provided is an information processing device including an image analysis unit which divides an entire image in which an entire observation target region is imaged into a plurality of regions, and then judges whether an observation target is present in each region, and an imaging control unit which controls imaging of partial images with a magnification higher than a magnification of the entire image corresponding to the regions based on judgment results of the image analysis unit.