Endoscopic Image Processing with 3D Reconstruction and Metadata Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In endoscopic examinations, there is a need to effectively utilize information obtained from preliminary CT or MRI examinations to enhance the diagnostic process.
Innovation Solution
An image processing device and method that includes three-dimensional reconstruction, matching, and display control units to align and display meta data from preliminary examinations with real-time endoscopic images, using techniques like Structure from Motion and non-rigid alignment to highlight relevant areas of interest.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If preliminary examination data from CT or MRI devices is utilized in endoscopic examination, then diagnostic accuracy is improved, but device complexity increases due to the need for integration and matching systems
Solution Approach 1:
The patent introduces a three-dimensional reconstruction unit and a matching unit as intermediary components. The three-dimensional reconstruction unit converts endoscopic images into three-dimensional data, and the matching unit aligns this reconstructed data with preliminary examination data from CT or MRI devices. These intermediaries facilitate the integration of different data sources without requiring direct complex interaction between the endoscope and imaging devices, thereby improving diagnostic accuracy while managing system complexity through modular architecture.
2Loss of information
If three-dimensional reconstruction and matching processing is performed in real-time during endoscopic examination, then information utilization is improved, but processing time increases
Solution Approach 1:
The patent performs three-dimensional reconstruction of endoscopic images and matching with preliminary examination data during the endoscopic examination procedure itself. By conducting these processing operations in real-time rather than as post-processing steps, the system ensures that reconstructed three-dimensional data and matched metadata are immediately available for diagnostic decision-making, maximizing information utilization while accepting the necessary processing time as part of the examination workflow.
Data Source
AI summary
The image processing device 1X mainly includes a three-dimensional reconstruction means 31X, a matching means 32X, and a display control means 33X. The three-dimensional reconstruction means 31X generates reconstructed data obtained by three-dimensionally reconstructing an examination target, based on endoscopic images of the examination target captured by a photographing unit provided in an endoscope. The matching means 32X performs matching between a three-dimensional model of the examination target and the reconstructed data. The display control means 33X displays information regarding meta data associated with the three-dimensional model, based on a result of the matching.