Virtual Endoscopic Viewpoint Inversion for Surgical Tool Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
During endoscopic surgery, the limited field of view of endoscopes makes it difficult for surgeons to recognize the approach of endoscopes or surgical tools to sites of interest, potentially leading to misoperations, as existing virtual endoscopic technologies often fail to display these instruments in relation to the site of interest due to similar viewpoint constraints.
Innovation Solution
A system that generates a virtual endoscopic image from a 3D medical image, with the viewpoint set at a structure of interest, ensuring the endoscope and surgical tool positions are within the field of view and displayed in an identifiable manner, complementing real-time endoscopic images to enhance visibility and prevent misoperations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a virtual endoscopic image is generated with the same viewpoint as the real endoscope, then the image processing is simplified, but the site of interest may not be visible and the approach of instruments cannot be recognized
Solution Approach 1:
Instead of setting the viewpoint at the endoscope position (conventional approach), the patent inverts the viewpoint to be at the site of interest, allowing the endoscope and surgical tools to be visualized approaching from different directions while maintaining clear visibility of the target site
Solution Approach 2:
The patent introduces a new dimensional perspective by positioning the viewpoint at the site of interest rather than at the endoscope, creating a virtual endoscopic image that shows instruments approaching from multiple angles simultaneously, thus providing spatial information not available in conventional single-viewpoint images
2Ease of operation
If the viewpoint is set at the endoscope position, then the real-time position tracking is simplified, but the surgical tool approach to the site of interest cannot be recognized
Solution Approach 1:
The patent inverts the conventional viewpoint positioning from endoscope-centered to site-of-interest-centered, enabling simultaneous visualization of multiple instruments' approaches while maintaining reliable recognition of surgical progression toward the target site
3Adaptability or versatility
If multiple instruments are used in endoscopic surgery, then the surgical capability is enhanced, but it becomes difficult to recognize the position and approach of each instrument
Solution Approach 1:
By positioning the viewpoint at the site of interest, the patent creates a multi-perspective virtual image that displays multiple instruments approaching from different directions simultaneously, preserving complete spatial information about each instrument's position and approach trajectory
Solution Approach 2:
The inverted viewpoint approach allows all instruments to be visualized relative to the target site, providing comprehensive instrument position information that enhances surgical capability while preventing information loss about instrument locations
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The user is allowed to more reliably recognize the approach of an endoscope or a surgical tool to a site of interest during observation of a body cavity of a subj ect using the endoscope inserted in the body cavity. A virtual endoscopic image generating unit (26) for generating, from a 3D medical image formed by a 3D medical image forming unit (5) inputted thereto, a virtual endoscopic image, in which a position of a structure of interest identified by a position of interest identifying unit (25) is the view point, a position of at least one of the endoscope and a surgical tool detected by an endoscope position detecting unit (11) or a surgical tool position detecting unit (12) is contained in the field of view of the virtual endoscopic image, and the position of at least one of the endoscope and the surgical tool is shown in an identifiable manner, is provided. A display control unit (27) causes a WS display (10) to display the generated virtual endoscopic image.