Endoscopic 3D Reconstruction with Pre-existing Model Complement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Three-dimensional model data generated from endoscopic images can become incomplete due to unphotographed regions in the examination target during endoscopic examinations.
Innovation Solution
An image processing device and method that includes three-dimensional reconstruction, matching, complement, and display control means to generate and display complemented reconstruction data by matching endoscopic images with a three-dimensional model, filling in unphotographed regions, and displaying the complete data on a device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If three-dimensional model data is generated from endoscopic images, then the examination target can be visualized in three dimensions, but unphotographed regions cause the model to become incomplete
Solution Approach 1:
The patent applies preliminary action by generating a complete three-dimensional model from pre-existing medical images (CT, MRI, or ultrasound) before the endoscopic examination. This preliminary model serves as a reference that includes all regions of the examination target, allowing the system to identify and fill in unphotographed regions during the actual endoscopy by comparing real-time captured images with the pre-generated model.
2Ease of manufacture
If endoscopic images are used to generate three-dimensional model data, then the examination can be performed with standard endoscopy equipment, but the model becomes incomplete due to limited view angles
Solution Approach 1:
The patent merges the endoscopic examination system with a pre-existing complete three-dimensional model generated from other medical imaging modalities (CT, MRI, or ultrasound). By combining the endoscopic images with this pre-generated complete model, the system maintains the simplicity of standard endoscopy equipment while achieving complete three-dimensional visualization, as the complementary model provides the missing information from regions not captured by the endoscope.
3Measurement precision
If the three-dimensional model is used to fill in unphotographed regions, then the completeness of the model improves, but the complexity of image processing increases
Solution Approach 1:
The patent uses a pre-generated complete three-dimensional model as an intermediary reference. This intermediary model, created from pre-existing medical images, serves as a mediator between the endoscopic images and the final complete three-dimensional representation. The processing system compares endoscopic images with this intermediary model to identify unphotographed regions and fills them in accordingly, thereby achieving complete modeling without requiring complex real-time processing algorithms.
Data Source
AI summary
The image processing device 1X mainly includes a three-dimensional reconstruction means 31X, a matching means 32X, a complement means 33X, and a display control means 34X. The three-dimensional reconstruction means generates, based on endoscopic images of an examination target captured by a photographing unit provided in an endoscope, reconstruction data obtained by three-dimensionally reconstructing the examination target. The matching means performs matching between a three-dimensional model of the examination target and the reconstruction data. The complement means generates, based on a result of the matching, complemented reconstruction data which is the reconstruction data complemented with the three-dimensional model. The display control means displays the complemented reconstruction data on a display device.