Virtual Microscope Image Combination with Connection Reliability Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Virtual microscope systems often produce images with low reliability due to distortions, magnification deviations, blurring, and connection accuracy errors, making it difficult for users to recognize and correct these issues during diagnosis.

Innovation Solution

An information processing apparatus and method that generates and displays connection information, including connection positions and reliability, along with combined images, to allow users to easily identify and assess the reliability of connected parts, with options to include foreign body presence and position information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple partial images are connected to create a wide-field microscopic image, then the field of view is expanded, but the connection accuracy and reliability of the combined image deteriorate due to distortions, magnification deviations, and blurring

Engineering Contradiction:
Improvefield of viewVSAvoidconnection accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent divides the wide-field observation area into multiple partial images that are connected together. Each partial image is processed and evaluated separately to determine connection reliability, allowing the system to maintain overall wide-field capability while managing local connection quality through segmentation of the imaging area.

Inventive Principle:
Principle #1Segmentation

2Reliability

If distortion correction is applied to improve image quality in connected parts, then local image quality improves, but new distortions and reliability issues are introduced at the connection positions

Engineering Contradiction:
Improveimage qualityVSAvoiddistortion errors
Core Design Contradiction:
ReliabilityVSObject-generated harmful factors

Solution Approach 1:

The patent evaluates connection reliability before final image combination by assessing distortion characteristics, magnification deviations, and blurring in each partial image. This preliminary evaluation allows the system to identify and flag potential reliability issues before they affect the final combined image, enabling users to be aware of potential problems in advance.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The system provides feedback to users about the reliability of different regions in the combined image through reliability maps or annotations. This feedback mechanism allows users to understand which areas of the combined image have high reliability and which areas may contain distortion errors or connection issues, enabling informed diagnostic decisions.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If connection information is not displayed to users, then the interface remains simple, but users cannot recognize reliability issues in connected parts for accurate diagnosis

Engineering Contradiction:
Improveinterface simplicityVSAvoidreliability information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent applies local quality by providing reliability information specifically at connection positions and regions where distortion may occur, rather than uniformly across the entire image. This allows the interface to remain relatively simple while still providing critical reliability information where it is most needed for diagnostic accuracy.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10051241B2Method and apparatus for image combination and displaying the combined image
Publication Date: 2018.08.14 SONY GROUP CORP
  • US10051241B2 patent drawing
  • US10051241B2 patent drawing
  • US10051241B2 patent drawing

AI summary

There is provided an information processing apparatus, including an image combination section which connects a plurality of partial images, each of which is an image obtained by imaging a part of a region to be observed, and a connection information generation section which generates connection information of a combined image combined by the image combination section. The connection information is provided, along with the combined image or separately from the combined image, to an image display apparatus capable of displaying the combined image.