Virtual Endoscope Measurement for 3D Surface Distance Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing minimally invasive medical procedures lack accurate methods for measuring and displaying three-dimensional surface traversing lines or shapes, which are crucial for precise surgical interventions.
Innovation Solution
A system that generates a virtual camera based on endoscope calibration data, allows for the generation of a three-dimensional surface model, and creates a mixed reality image with curvilinear segments between marked points to accurately measure surface traversing distances.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional two-dimensional measurement methods are used in endoscopic imaging, then the device complexity is low, but the measurement precision of three-dimensional surface traversing distances is insufficient
Solution Approach 1:
The patent transforms two-dimensional endoscopic images into three-dimensional measurements by generating a virtual camera model and surface model. The system calculates depth information and generates three-dimensional coordinates from two-dimensional image data, enabling accurate measurement of surface traversing distances without adding physical three-dimensional sensing hardware to the endoscope.
Solution Approach 2:
The patent creates a virtual copy of the endoscopic scene through computational modeling. A virtual camera is generated that replicates the optical properties of the physical endoscope, and a surface model is constructed that copies the anatomical structure. This virtual model allows for accurate three-dimensional measurements to be taken and displayed alongside the original two-dimensional endoscopic view.
2Measurement precision
If a virtual camera and surface model are generated to enable accurate three-dimensional measurement, then the measurement precision improves, but the device complexity increases
Solution Approach 1:
The patent replaces physical three-dimensional measurement hardware with computational methods. Instead of adding mechanical depth-sensing devices or multiple physical cameras, the system uses image processing algorithms, virtual camera modeling, and mathematical calculations to extract three-dimensional measurement information from standard two-dimensional endoscopic images.
3Measurement precision
If curvilinear segments are generated along anatomical surfaces to measure surface traversing distances, then the measurement precision increases, but the ease of operation decreases due to complex image processing
Solution Approach 1:
The system automatically performs the complex tasks of virtual camera generation, surface model construction, and curvilinear segment calculation without requiring manual intervention. The processor autonomously generates the three-dimensional surface model from the endoscopic images and computes the measurement paths along the anatomical surfaces, reducing the operational burden on the user.
Data Source
AI summary
A system may comprise a processor and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, cause the system to receive endoscope calibration data, generate a virtual camera based on the calibration data, generate an endoscopic image, receive first and second marked points in the endoscopic image, and determine if a three-dimensional surface model has been generated. If a surface model has been generated, a perturbation in the virtual camera is generated. A curvilinear segment on the surface model may be generated between the first and second marked points and a mixed reality image, including the curvilinear segment and the endoscopic image, may be generated.