Endoscopic Image Projection Into 3D Anatomy for Surgical Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Surgeons performing minimally invasive medical procedures have limited situational awareness of the surgical environment beyond the vantage point of the endoscopic view, which can hinder their ability to navigate and operate effectively.
Innovation Solution
A system and method that integrates an endoscopic image dataset with an anatomic model dataset to provide a surgeon with enhanced perspective by displaying images from multiple vantage points, including the distal end of the endoscope and additional viewpoints within and outside the patient anatomy, using registration and mapping techniques to overlay endoscopic images onto three-dimensional anatomic models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a single endoscopic view is used during minimally invasive procedures, then the simplicity of the imaging system is maintained, but the surgeon's situational awareness of the surgical environment is limited
Solution Approach 1:
The patent combines multiple imaging data sources including endoscopic video data, pre-operative medical images (CT, MRI), and real-time sensor data into a unified augmented reality display. This merging provides comprehensive situational awareness by integrating information from different modalities into a single cohesive view that shows both the immediate surgical field and surrounding anatomical context.
Solution Approach 2:
The augmented reality display system serves multiple functions simultaneously: it displays the primary endoscopic view, overlays anatomical landmarks from pre-operative imaging, shows real-time instrument positions, and provides navigation guidance. This multi-functionality allows a single system to address various information needs without requiring separate dedicated devices for each function.
2Loss of information
If multiple imaging systems and data sources are integrated to provide enhanced perspective, then situational awareness is improved, but system complexity increases
Solution Approach 1:
The patent introduces a computer processing system as an intermediary that automatically registers, aligns, and integrates data from multiple imaging systems and sensors. This intermediary handles the complex tasks of coordinate system transformation, image registration, and data fusion, reducing the burden on surgeons to manually manage multiple systems while providing seamless integrated information.
Solution Approach 2:
The system creates virtual copies and representations of anatomical structures from pre-operative imaging data, allowing these digital models to be overlaid on the real surgical field. These virtual copies provide contextual information about underlying anatomy without requiring physical models or additional invasive imaging during the procedure.
3Measurement precision
If real-time endoscopic imaging is used, then the surgeon has a clear view of the immediate surgical field, but awareness of areas beyond the endoscopic vantage point is reduced
Solution Approach 1:
The patent overlays two-dimensional anatomical information from pre-operative imaging onto the three-dimensional real-time endoscopic view. This addition of anatomical context in another dimension (the underlying anatomical structures visible through transparency or segmentation) provides spatial orientation and contextual information about areas not directly visible in the endoscopic field without compromising the primary visual acuity.
Data Source
AI summary
A method comprises obtaining an endoscopic image dataset of a patient anatomy from an endoscopic imaging system and retrieving an anatomic model dataset of the patient anatomy obtained by an anatomic imaging system. The method also comprises mapping the endoscopic image dataset to the anatomic model dataset and displaying a first vantage point image using the mapped endoscopic image dataset. The first vantage point image is presented from a first vantage point at a distal end of the endoscopic imaging system. The method also comprises displaying a second vantage point image using at least a portion of the mapped endoscopic image dataset. The second vantage point image is presented from a second vantage point, different from the first vantage point.