Surgical Image Display With Anatomy-Selected Multi-Modality Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image guided surgical techniques lack the ability to effectively integrate multiple imaging modalities to enhance visualization of surgical scenes, particularly for minimally invasive procedures, which can hinder precise surgical instrument positioning and anatomical structure identification.
Innovation Solution
A method is provided to produce multi-modality images by capturing light reflected from a surgical scene, selecting portions of second modality images based on anatomic structural information, user eye focus, or surgical stage, and using a computer to simultaneously display these images with first modality images, enhancing visualization through techniques like NBI, Raman spectroscopy, and hyperspectral imaging.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple imaging modalities are integrated to enhance visualization, then anatomical structure identification and surgical precision are improved, but device complexity and image processing requirements increase
Solution Approach 1:
The patent combines multiple imaging modalities (NBI, Raman spectroscopy, hyperspectral imaging, and standard white light imaging) into a single integrated surgical visualization system. The computer system processes and displays multiple image types simultaneously, allowing surgeons to benefit from enhanced anatomical structure identification while using a unified device rather than separate systems for each modality.
2Loss of information
If multiple image modalities are displayed simultaneously, then surgical visualization is enhanced, but information processing load and computational requirements increase
Solution Approach 1:
The patent segments the display of multiple image modalities by showing them in different regions or layers within the surgical display interface. The computer system processes each modality separately and presents them in an organized manner, reducing the computational burden of handling all images as a single unified processing task while still providing complete surgical scene information.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach improves surgical precision by providing enhanced visualization of anatomical structures, allowing for safer and more effective minimally invasive procedures by integrating multiple imaging modalities to improve depth perception and structural identification.
Implementation Method 1
A camera captures light reflected from the surgical scene
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A method is provided to produce a multi-modality image of a surgical scene comprising: capture light reflected from the surgical scene; producing first image information corresponding to a first modality image; producing second image information corresponding to a second modality image; selecting a portion of the second image modality based at least in part upon anatomical structure information included within the selected portion; and producing simultaneously within a display at least a portion of the first modality image of the surgical scene and the selected portion of the second modality image.