Virtual Endoscopic Image Generation Device Opacity Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual endoscopic image generation techniques struggle to effectively display structures of interest by making them visible based on their distance from the viewpoint, leading to difficulties in understanding the positional relationship between the endoscope and the target structure during surgeries.
Innovation Solution
A virtual endoscopic image generation device and method that utilize image obtaining, structure extraction, viewpoint determination, and display attribute management to change the opacity of structures based on their distance from the viewpoint, ensuring structures are appropriately visible by adjusting opacity values between threshold distances.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a color template defining opacity is applied to all structures to make them semi-transparent, then structures of interest become visible even when obstructed by other structures, but all structures including the structure of interest are displayed as semi-transparent making it difficult to see the structure of interest
Solution Approach 1:
The patent applies different opacity values to different structures based on their identification results. The control unit sets a first opacity value for the first structure (structure of interest) and a second opacity value for the second structure (obstructing structure), allowing selective transparency control to make the structure of interest visible while maintaining its clarity
Solution Approach 2:
The patent dynamically changes the opacity parameter of virtual endoscopic images based on the distance between the viewpoint and structures. When a structure is identified as the structure of interest, its opacity is adjusted to a first value that makes it clearly visible, while obstructing structures are adjusted to a second opacity value that allows the structure of interest to be seen through them
2Area of stationary object
If the viewpoint position and observation direction of the virtual endoscope are aligned with those of the real endoscope, then the virtual endoscopic image compensates for the narrow field of view, but the positional relationship between the endoscope and the part of interest becomes difficult to understand
Solution Approach 1:
The patent introduces a new dimension of information display by superimposing the real endoscopic image and virtual endoscopic image with different transparency levels. This allows the system to simultaneously provide the wide field of view of the virtual endoscope and the accurate positional relationship information from the real endoscope, resolving the contradiction between field of view and positional accuracy
3Reliability
If another structure is present between the viewpoint position of a virtual endoscope and the structure of interest, then the structure of interest cannot be seen in the virtual endoscopic image, but applying semi-transparent display to all structures makes it difficult to see the structure of interest
Solution Approach 1:
The patent uses the semi-transparent virtual endoscopic image as an intermediary layer that allows observation of the structure of interest through obstructing structures. By controlling the opacity of different structures differently, the system maintains the mediating function of the virtual image while ensuring the structure of interest remains easily identifiable
Data Source
AI summary
A structure extracting unit extracts a structure from a three-dimensional medical image, and a view point determining unit determines a view point position and a direction of line of sight of a virtual endoscopic image. An image generating unit calculates a distance between the view point position and the extracted structure, changes an opacity defined in a color template depending on the distance, and generates, from the three-dimensional medical image, a virtual endoscopic image containing the structure shown according to the color template with the changed opacity viewed from the view point position in the direction of line of sight. A display control unit displays the thus generated virtual endoscopic image on a WS display.