Steerable Endoscope Augmented View for Team Position Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
It is difficult for medical professionals other than the endoscope operator to maintain an accurate understanding of the endoscope's position within a patient's cavity during procedures due to unpredictable motion translation and limited visibility of the camera image.
Innovation Solution
A computer-controlled endoscope system with a steerable distal tip and augmented reality display that overlays a computer-generated anatomical model and endoscope marker on a real-world view, providing real-time position and orientation data through a head-mounted viewer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a traditional endoscope system with a single camera display is used, then the endoscope operator can view the camera image, but other medical professionals cannot accurately track the endoscope's position and orientation within the patient's cavity
Solution Approach 1:
The patent creates a virtual copy of the endoscope (graphical marker) that replicates the physical endoscope's position and orientation within a 3D anatomical model. This virtual copy is displayed on augmented reality head-mounted displays, allowing team members to track the endoscope's location without directly observing the physical device or relying on 2D camera images. The virtual copy maintains real-time correspondence with the actual endoscope, solving the information loss problem while enabling easy team coordination.
Solution Approach 2:
The patent introduces a 3D anatomical model as an intermediary representation between the physical endoscope and the observers. Instead of directly viewing the endoscope or 2D camera images, team members observe the endoscope's position within the contextual 3D anatomical model through augmented reality displays. This intermediary provides intuitive spatial understanding of the endoscope's location within the patient's anatomy, resolving both the information loss and coordination difficulties.
2Adaptability or versatility
If the endoscope is steered to navigate through complex anatomy, then the desired view can be obtained, but the position translation becomes unpredictable and harder to track
Solution Approach 1:
The patent transitions from 2D camera images to a 3D anatomical model for displaying endoscope position. The graphical marker exists within the three-dimensional virtual anatomical space, preserving spatial relationships and orientation information that are lost in 2D representations. This dimensional enhancement allows accurate tracking of the endoscope's position and orientation even during complex steering maneuvers through tortuous anatomy, as the 3D model maintains geometric fidelity to the actual anatomical structures.
3Area of stationary object
If multiple displays are used to show camera images, then more people can view the images, but the spatial context and position understanding remain limited
Solution Approach 1:
The patent creates a virtual copy of the endoscope environment within a 3D anatomical model that is displayed on augmented reality head-mounted displays. Unlike traditional multiple 2D displays that only show camera images, this virtual copy preserves complete spatial context, orientation, and positional information in three dimensions. Team members wearing the AR displays can view the endoscope's position within the anatomical model from any angle, maintaining full spatial context while providing wide accessibility to multiple observers simultaneously.
Data Source
AI summary
A steerable endoscope system is provided with an augmented view. An augmented reality display includes a rendered model of an anatomical structure corresponding to a patient anatomy pinned in the field of view, an endoscope marker moving through the virtual model, and an image from an endoscope at a location within the patient anatomy.