Virtual Endoscopic Image Generation for Operation Assistance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing tumor examination methods using endoscopes face challenges in providing accurate diagnosis support due to geometric distortions and large measurement errors in two-dimensional endoscopic images, and the virtual endoscope technology does not provide operation assistance based on endoscopic and virtual endoscopic images.
Innovation Solution
A program and system that acquire both endoscopic images from an endoscope and three-dimensional medical images from X-ray CT, MRI-CT, or ultrasonic diagnosis apparatuses, generate virtual endoscopic images, calculate distance image information, and output operation assistance information to help guide endoscope operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If only two-dimensional endoscopic images are used for diagnosis, then the examination can be performed simply, but geometric distortion occurs and measurement error increases
Solution Approach 1:
The patent introduces a three-dimensional medical image (CT or MRI) as an intermediary reference to correct the geometric distortion in two-dimensional endoscopic images. By registering the endoscopic image with the three-dimensional medical image, the system obtains accurate spatial coordinates and distance information, thereby resolving the measurement accuracy problem while maintaining the simplicity of endoscopic examination
Solution Approach 2:
The patent transitions from two-dimensional endoscopic imaging to three-dimensional spatial reconstruction by integrating three-dimensional medical images. This dimensional enhancement allows the system to calculate accurate distances and spatial relationships, solving the measurement error issue inherent in two-dimensional images
2Loss of information
If virtual endoscopic images are generated from three-dimensional medical images, then spatial information is provided, but operation assistance information is not provided
Solution Approach 1:
The patent merges the virtual endoscopic image generation function with operation assistance information provision. By integrating the endoscopic image, three-dimensional medical image, and operation information into a unified system, the patent simultaneously provides both accurate spatial information and real-time operation guidance, resolving the limitation of existing virtual endoscope technology
3Measurement precision
If endoscopic images and three-dimensional medical images are integrated, then accurate distance information is obtained, but system complexity increases
Solution Approach 1:
The patent uses the three-dimensional medical image as an intermediary framework to register and integrate endoscopic images. This intermediary approach provides a unified coordinate system that simplifies the integration process, enabling accurate distance measurement without excessive system complexity
Solution Approach 2:
The patent creates a multi-functional integration system that simultaneously achieves image registration, distance calculation, and operation assistance. By designing the system to perform multiple functions through a unified approach, the patent reduces overall complexity compared to separate systems for each function
Data Source
AI summary
There is provided a program causing a computer to execute processing including: acquiring an endoscopic image of a subject from an endoscope; acquiring a three-dimensional medical image obtained by capturing an image of an internal body portion of the subject by means of X-ray CT, X-ray cone beam CT, MRI-CT, or an ultrasonic diagnosis apparatus configured to capture a three-dimensional image of an internal body portion of the subject; generating a virtual endoscopic image reconfigured from the three-dimensional medical image, based on the acquired endoscopic image; calculating distance image information in the endoscopic image based on the virtual endoscopic image and the endoscopic image; and outputting operation assistance information on an operation of the endoscope based on the distance image information and the three-dimensional medical image.