Surgical Microscope Image Guidance for Tool Insertion Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing ophthalmic surgery guidance systems face limitations in accurately and timely reflecting surgeon's instructions, particularly in detecting the insertion of surgical tools, leading to reduced convenience and accuracy in surgical procedures.

Innovation Solution

An image processing device that includes an image input unit, a display image generation unit, and a processing start unit to superimpose guides on the operative field image and detect surgery start instructions, allowing for high-accuracy and real-time input of surgeon's instructions, such as the insertion of surgical tools, to acquire appropriate surgery start-time images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a guide is displayed on the operative field image to indicate surgery start instruction, then the ease of operation is improved, but the device complexity increases

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The display image generation unit processes the operative field image by segmenting it into multiple regions, including a guide region and an operative field region. This segmentation allows the guide to be displayed in a structured manner without overwhelming the surgeon with information, improving ease of operation while managing device complexity through organized image processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The guide displayed on the operative field image acts as an intermediary element that mediates between the surgical tool and the surgeon's intent. It provides visual feedback about the surgery start instruction without requiring direct complex interactions, thereby improving ease of operation while the system manages the complexity internally.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If the system detects surgical tool insertion automatically, then the productivity is improved, but the measurement precision requirement increases

Engineering Contradiction:
ImproveproductivityVSAvoidmeasurement precision
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The processing start unit implements a feedback mechanism where the display image generation unit continuously monitors the operative field image for surgical tool insertion. When the surgical tool enters the guide region, the system provides visual feedback by highlighting or confirming the detection, allowing the surgeon to verify the automatic detection. This feedback loop improves productivity by enabling automatic detection while managing measurement precision requirements through verification.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs partial detection by focusing on specific regions of interest within the operative field image, particularly the guide region where surgical tool insertion is expected. This partial action approach improves productivity by not requiring analysis of the entire image while maintaining sufficient measurement precision for the critical detection area.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS12465439B2Image processing device, image processing method, and surgical microscope system
Publication Date: 2025.11.11 SONY GROUP CORP
  • US12465439B2 patent drawing
  • US12465439B2 patent drawing
  • US12465439B2 patent drawing

AI summary

Provided an image processing device (13) including an image input unit (13b) that receives an operative field image; a display image generation unit (13f) that superimposes a first guide guiding a user to a motion of a surgery start instruction on the operative field image to generate a display image; and a processing start unit (13g) that starts surgery start-time processing when having detected the surgery start instruction within the first guide.