Surgery System OCT Camera Tool Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

During microsurgical interventions, surgeons face challenges in estimating the distance between surgical tools and tissue due to poor visibility of tools in OCT images and shadowing issues, which can lead to unintentional damage to sensitive tissues.

Innovation Solution

A surgery system combining an OCT system with a camera and magnifying optics, using geometry data of surgical tools to enhance visual supervision by generating complementary images that clearly represent both the tool and tissue, overcoming shadowing and visibility issues through object recognition and selective depth scanning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If OCT imaging is used to obtain depth information of tissue, then measurement precision of tool-tissue distance is improved, but tools are badly visible in OCT images and shadowing occurs making it difficult to estimate distance

Engineering Contradiction:
Improvetool-tissue distance estimationVSAvoidvisibility of tool and shadowed tissue regions
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent combines two imaging modalities - the microscope providing top-view images with good tool visibility, and the OCT system providing depth-resolved cross-sectional images with shadowing. By merging these complementary imaging approaches, the system achieves both accurate distance measurement from OCT and clear tool visualization from the microscope, resolving the contradiction between measurement precision and information loss.

Inventive Principle:
Principle #5Merging (Combining)

2Area of stationary object

If OCT scans cover large object areas where the tool may be located, then comprehensive tissue coverage is improved, but scan time increases making real-time representation difficult

Engineering Contradiction:
Improvetissue coverage areaVSAvoidscan time
Core Design Contradiction:
Area of stationary objectVSLoss of time

Solution Approach 1:

The patent segments the imaging task by dividing it into two complementary components: the microscope continuously monitors the entire field of view for real-time tool position, while the OCT system performs selective depth scanning only at specific locations where distance measurement is needed. This segmentation allows comprehensive monitoring without requiring full-area OCT scans, thus maintaining real-time performance while providing depth information where required.

Inventive Principle:
Principle #1Segmentation

3Ease of operation

If the surgeon views through oculars of the surgery microscope, then visual supervision is provided, but it is difficult to estimate the distance from the tool to the tissue

Engineering Contradiction:
Improvevisual supervisionVSAvoidtool-tissue distance estimation
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary processing system that receives images from both the microscope and OCT system, then synthesizes them into a composite representation. This intermediary image processing and fusion mechanism provides the surgeon with enhanced visual information that includes both the top-view context from the microscope and the depth-distance information from OCT, enabling accurate distance estimation while maintaining ease of visual supervision.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system allows for precise visual supervision and accurate estimation of tool-tissue distance, reducing the risk of tissue damage by providing clear, enhanced images of both the tool and tissue layers, even in shadowed regions.

Implementation Method 1

The OCT system works according to the principle of the optical coherence tomography and detects light which is backscattered from the selected locations in dependence of the tissue depth

Methodology Applied
Scientific EffectOptical coherence tomography: Interference

Implementation Method 2

The optics are configured to image a field of view onto the camera so that the camera may obtain two-dimensional camera images of the field of view

Methodology Applied
Scientific EffectLight detection: Light

Data Source

PatentEP2949284B1Surgery system with oct imaging
Publication Date: 2021.08.04 CARL ZEISS MEDITEC AG
  • EP2949284B1 patent drawingFigure 1
  • EP2949284B1 patent drawingFigure 2
  • EP2949284B1 patent drawingFigure 3A~3G

AI summary

A surgery system comprises a camera obtaining camera images, an OCT system, a data memory storing geometry data of a surgical tool 133 and a controller configured to identify a first portion of the tool in the camera images by object recognition using the geometry data; to determine, in the field of view, first locations where the tool is located and second locations aside of the tool; to trigger the OCT system to perform depth scans at the first and second locations; to identify a second portion 153 of the tool in the depth scans by object recognition using the geometry data; and to generate a first image 154 representing a third portion 157 of the tool based on the geometry data and the depth scans.