Surgical Microscope Image Segmentation for Occlusion-Free Eye Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The superimposition of preoperative marks on operative field images during ophthalmic surgery leads to occlusion, making it difficult for operators to accurately perform surgeries according to the preoperative plan.

Innovation Solution

An image processing apparatus that tracks the eyeball in real-time and generates display images with regions having different display modes, adjusting boundaries based on the eyeball's movement to ensure accurate alignment with the preoperative plan without occluding the operative field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If preoperative marks are superimposed on operative field images, then alignment accuracy with preoperative plan is improved, but visibility of operative field is deteriorated due to occlusion

Engineering Contradiction:
Improvealignment accuracyVSAvoidvisibility of operative field
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The display screen is divided into multiple regions: a first region displaying the operative field image and a second region displaying the preoperative plan image. This spatial segmentation allows both the operative field and preoperative marks to be visible simultaneously without mutual occlusion, resolving the contradiction between alignment accuracy and field visibility.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of superimposing the preoperative marks on the operative field image in the same spatial plane, the invention displays them in separate regions on the display screen. This dimensional reorganization eliminates occlusion while maintaining the ability to align surgical instruments with preoperative plans by visually comparing the two separate displays.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If marks are superimposed on operative field image to guide surgery, then surgical guidance is improved, but operator's view of operative field is blocked

Engineering Contradiction:
Improvesurgical guidanceVSAvoidoperative field visibility
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The display is segmented into a first region for the operative field image and a second region for the preoperative plan with marks. This allows the operator to view the operative field clearly in the first region while simultaneously accessing surgical guidance information in the second region, eliminating the blocking effect while maintaining ease of operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The display screen acts as an intermediary that presents both the operative field image and preoperative plan in separate regions. This intermediary approach allows the operator to obtain surgical guidance without the marks directly obstructing the view of the operative field, maintaining both visibility and ease of operation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If preoperative plan information is displayed on operative field image, then surgical accuracy is improved, but clarity of operative field image is reduced

Engineering Contradiction:
Improvesurgical accuracyVSAvoidimage clarity
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The display screen is segmented into distinct regions: the first region shows the operative field image with high clarity, and the second region shows the preoperative plan information. This segmentation maintains image clarity in the operative field region while providing surgical accuracy guidance through the separate preoperative plan display, allowing operators to reference both without degradation of image quality.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12560999B2Image processing apparatus, image processing method, and surgical microscope system
Publication Date: 2026.02.24 SONY GROUP CORP
  • US12560999B2 patent drawing
  • US12560999B2 patent drawing
  • US12560999B2 patent drawing

AI summary

An image processing apparatus (13) according to an aspect of the present disclosure includes: an image input unit (13b) that receives an operative field image for an eye of a patient; an eyeball tracking unit (13e) that tracks an eyeball in the operative field image; and a display image generation unit (13f) that sets a plurality of regions having different display modes for the operative field image and generates a display image in which a boundary of the plurality of regions indicate at least one of a specific position, a specific direction, and a specific size for the eye, in which the display image generation unit (13f) changes a display mode of any or all of the plurality of regions on the basis of a tracking result of the eyeball, and changes at least one of a position, a direction, and a size of the boundary.