Ophthalmic Navigation Image Generation Using Magnification Acquisition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing ophthalmic surgery guidance systems face challenges in presenting navigation information with high speed and precision due to computational complexity from alignment processing, especially with changes in imaging conditions such as rotation, scale, and illumination.

Innovation Solution

An information processing apparatus that includes a magnification acquisition unit and an image generation unit, which utilize the magnification changes between reference and target images to generate navigation images, reducing computational complexity by using known magnification for image matching, particularly employing SIFT methods with narrowed search ranges for characteristic point detection and matching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If alignment processing is performed to update navigation information in response to imaging condition changes, then precision of navigation information is improved, but processing speed deteriorates due to high computational complexity

Engineering Contradiction:
Improveprecision of navigation informationVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent applies preliminary action by pre-calculating and storing feature point information from examination images before surgery. This allows the system to quickly retrieve and match pre-prepared navigation information during surgery without performing complex real-time alignment calculations, thereby maintaining high precision while improving processing speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts and separates the alignment processing into distinct stages: preoperative feature extraction and storage, and intraoperative matching and retrieval. By taking out the computationally intensive feature extraction step and performing it beforehand, the system reduces real-time computational complexity while preserving navigation precision through accurate feature matching.

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If comprehensive alignment processing is performed to account for rotation, scale changes, and illumination changes, then reliability of navigation information is improved, but device complexity increases

Engineering Contradiction:
Improvereliability of navigation informationVSAvoidcomplexity of alignment processing
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the alignment processing into multiple independent modules: feature point detection, rotation alignment, scale adjustment, and illumination normalization. Each module handles a specific aspect of alignment independently, making the overall system more manageable and less complex while maintaining comprehensive alignment capability for reliable navigation information.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs parameter changes by adjusting alignment parameters (rotation angles, scale factors, illumination levels) based on detected feature point correspondences between examination and surgery images. This allows the system to adapt to various imaging conditions dynamically without requiring a completely different processing approach for each condition, thereby improving reliability while controlling complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3235477B1Information processing device, surgical microscope system and information processing method
Publication Date: 2022.01.26 SONY GROUP CORP
  • EP3235477B1 patent drawingFigure 1~2
  • EP3235477B1 patent drawingFigure 3~4
  • EP3235477B1 patent drawingFigure 5~6

AI summary

[Object] To provide an information processing apparatus that is capable of presenting navigation information for ophthalmic surgery at high speed and with high precision. [Solving Means] An information processing apparatus according to the present technology includes a magnification acquisition unit and an image generation unit. The magnification acquisition unit acquires a magnification of a target image with respect to a reference image, the reference image being an image of an eye to be treated, the target image being an image of the eye picked up at a time different from an imaging time of the reference image. The image generation unit generates a navigation image including navigation information for guiding treatment of the eye on the basis of the magnification acquired by the magnification acquisition unit.