Projection Image Generation for Surgical Tool Path Visualization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In endoscopic surgery, it is difficult to understand the operation direction of a treatment tool relative to a lesion in a virtual endoscopic image, as the visual line direction differs from the tool's operation direction, making it challenging to determine if structures like blood vessels are in the tool's path to the lesion.
Innovation Solution
A projection image generation apparatus and method that sets an assumed position for a treatment tool in a three-dimensional medical image, detects the surface of a structure, identifies masked structures, and detects intersection points between the tool's path and the structure's surface, displaying these points in the projection image to clearly indicate the tool's entry position relative to masked structures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If virtual endoscopic images are generated from endoscope viewpoints, then the field angle is wider than the actual endoscope, but it becomes difficult to understand the operation direction of the treatment tool and whether structures are in the tool's path
Solution Approach 1:
The patent projects the treatment tool's operation path from three-dimensional space onto a two-dimensional projection plane, creating a visual representation that preserves spatial relationship information. By displaying the entry position where the tool's path intersects with organ surfaces in the projection image, the system maintains operational direction information while providing a wider field of view.
Solution Approach 2:
The patent introduces a projection image as an intermediary representation between the actual endoscopic view and the treatment tool's operation path. This projection image serves as a mediator that displays both the widened field of view and the tool's entry position information, allowing surgeons to understand both the broader anatomical context and the specific operational path simultaneously.
2Loss of information
If translucent processing is applied to observe structures like blood vessels, then other structures in the organ become visible, but it remains difficult to understand whether these structures are in the treatment tool's approaching path
Solution Approach 1:
The patent extracts the critical information of entry positions from the complex three-dimensional surgical scene and displays them specifically marked on the projection image. By separating and highlighting only the intersection points where the treatment tool's path meets organ surfaces, the system makes path detection straightforward while maintaining visibility of underlying structures through translucent processing.
Solution Approach 2:
The patent uses visual marking (color changes or distinctive display) of entry positions on the projection image to differentiate them from other anatomical structures. This visual emphasis allows surgeons to quickly identify where the treatment tool enters organs, even when translucent processing reveals multiple overlapping structures, by displaying entry positions in a visually distinct manner.
Data Source
AI summary
When generating a projection image which is an image formed of image information on a plurality of visual lines viewing a first structure in a three-dimensional medical image from a given viewpoint being projected on a given projection plane, setting an assumed position of a treatment tool in the three-dimensional image, detecting a surface of the first structure from the three-dimensional medical image, identifying a second structure in the three-dimensional medical image located at a position masked by the first structure, detecting an intersection point between an assumed path formed when the treatment tool is moved from the assumed position towards the second structure and the surface of the first structure, and displaying the intersection point in an identifiable manner at a position to which image information on a visual line connecting the viewpoint and the intersection point is projected.