Unified Object Image Synchronization for Pathological Slide Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for simultaneously displaying multiple pathological images stained with different techniques pose challenges in accurate alignment and comparison due to positional and size variations, making it difficult for pathologists to efficiently diagnose corresponding tissue samples.

Innovation Solution

An information processing apparatus and method that synchronously displays unified object images by extracting corresponding regions from multiple input images, correcting their orientations, positions, and sizes, and providing display control units for various display modes such as guide scroll, automatic division, instantaneous switch, cut and placement, leaf-through, and multiple staining color combining.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple pathological images stained with different methods are displayed simultaneously for comparison, then diagnostic accuracy is improved, but image alignment precision deteriorates due to positional and size variations

Engineering Contradiction:
Improvediagnostic accuracyVSAvoidimage alignment precision
Core Design Contradiction:
ReliabilityVSManufacturing precision

Solution Approach 1:

The patent creates virtual copies of pathological images through digital imaging technology, allowing multiple stained specimens to be displayed simultaneously on a screen without physical manipulation. This copying approach enables accurate alignment through digital processing while maintaining the ability to compare multiple staining methods (H&E, IHC, FISH) on the same coordinate system, thereby improving diagnostic accuracy without sacrificing alignment precision.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system applies parameter changes to unified the positional and size parameters of corresponding objects across different images. By adjusting coordinates, magnification levels, and rotation angles digitally, the system aligns images from different staining methods while preserving their diagnostic information. This allows accurate comparison without the physical alignment errors that would occur with traditional methods.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If multiple staining methods are applied to the same tissue specimen, then diagnostic information completeness is improved, but image complexity increases making diagnosis more difficult

Engineering Contradiction:
Improvediagnostic information completenessVSAvoidimage complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the diagnostic information by allowing selective display of different staining methods. The system can show H&E, IHC, FISH, or combinations thereof based on diagnostic needs, breaking down the complex multi-staining information into manageable segments. This segmentation reduces cognitive load while preserving access to complete diagnostic information when needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system adds a temporal dimension to image comparison by enabling instantaneous switching between different staining methods and guide scroll display that sequentially shows corresponding regions. This dimensional transformation allows the pathologist to process complex multi-staining information in a controlled sequence rather than being overwhelmed by simultaneous presentation of all stains.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If corresponding portions of multiple prepared specimens are manually aligned by moving observing positions, then operational simplicity is maintained, but alignment accuracy and diagnostic efficiency deteriorate

Engineering Contradiction:
Improveoperational simplicityVSAvoiddiagnostic efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces the mechanical system of physically moving specimens under a microscope with a digital image processing system. The unified display control unit automatically aligns images through coordinate transformation and digital manipulation, eliminating the need for manual specimen repositioning. This substitution maintains ease of operation through simple screen interactions while dramatically improving alignment accuracy and diagnostic efficiency through precise digital control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11817202B2Information processing apparatus, information processing method, and program
Publication Date: 2023.11.14 SONY GROUP CORP
  • US11817202B2 patent drawing
  • US11817202B2 patent drawing
  • US11817202B2 patent drawing

AI summary

Provided is an information processing apparatus including an image supply unit that supplies a plurality of input images showing corresponding objects to an image processing unit and obtains a plurality of object images as an image processed result from the image processing unit, and a display control unit that synchronously displays the plurality of object images that have been obtained. The object images are regions including the corresponding objects extracted from the plurality of input images, and orientations, positions, and sizes of the corresponding objects of the plurality of object images are unified.