Endoscopic 3D Model Overlay for Limited-View Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Endoscopic imaging in minimally invasive surgeries, such as endoscopic spine surgery, faces challenges in accurately orienting within patient anatomy due to limited field of view and difficulty in identifying anatomical structures, especially when there is only one entry path for instruments and endoscope.
Innovation Solution
A system that utilizes a data processing unit to determine the 3D position and orientation of the endoscope relative to the anatomy, augments endoscopic images with 3D model information, and employs deep neural networks to classify and outline anatomical structures, allowing for virtual image generation and navigation assistance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If endoscopic imaging is used for minimally invasive surgery, then tissue damage and incision size are reduced, but the field of view is limited and anatomical structure identification becomes difficult
Solution Approach 1:
The patent overlays 3D anatomical model information onto the 2D endoscopic image, adding a third dimension of spatial context. This allows surgeons to see depth and anatomical relationships that are not visible in the flat endoscopic view, effectively expanding the field of view without requiring larger incisions.
Solution Approach 2:
The system introduces a computational intermediary that processes both the endoscopic image and pre-operative imaging data (CT/MRI), then synthesizes an augmented reality view. This intermediary layer bridges the gap between the limited endoscopic view and the complete anatomical picture, providing contextual information without physical expansion of the surgical field.
2Length of moving object
If a single entry path is used for instruments and endoscope, then incision size is minimized, but orientation within patient anatomy becomes difficult
Solution Approach 1:
The augmented reality system acts as an intermediary navigation aid, superimposing directional cues and anatomical landmarks from 3D models onto the endoscopic view. This provides surgeons with orientation information without requiring multiple incisions or larger access points.
Solution Approach 2:
The system uses color-coded overlays to highlight different anatomical structures, boundaries, and instrument paths. These visual distinctions help surgeons rapidly identify and orient themselves within the anatomy through the single endoscopic portal, making navigation intuitive despite the limited view.
3Object-affected harmful factors
If traditional endoscopic imaging is used, then minimally invasive access is achieved, but recognition of anatomical structures is challenging
Solution Approach 1:
The system introduces an image processing intermediary that fuses real-time endoscopic imagery with pre-operative anatomical data. This computational layer automatically identifies and highlights anatomical structures, making them easily recognizable without requiring larger incisions or direct visualization.
Solution Approach 2:
Different anatomical structures are highlighted with distinct color overlays, boundaries, and visual markers. This enhances the contrast and recognizability of anatomical features in the endoscopic view, allowing surgeons to quickly identify structures without compromising the minimally invasive approach.
Data Source
AI summary
Device and methods are provided for augmenting image information of an endoscope. The devices comprise at least a data processing unit. The endoscope is configured to provide video images of at least a part of an outer surface of an anatomy of interest in front of a distal tip thereof. The data processing unit is configured to determine a 3D position and orientation of the endoscope relative to the anatomy of interest, to receive a model of the anatomy of interest, and to augment a video image provided by the endoscope with information of the model of the anatomy of interest. The 3D position and orientation of the endoscope may be determined by a tracking device and/or based on at least one X-ray image. The model of the anatomy of interest may be based on an anatomy scan.