Endoscopic Object Measurement Using 3D Image Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing endoscopic surgical instruments lack effective methods for accurately measuring and visualizing the size of objects within a surgical site, which can hinder precise surgical procedures.
Innovation Solution
A system and method utilizing an imaging device and neural network to determine the size of objects based on pixel depth, focal length, and field of view, with optional structured light and re-centering capabilities, and providing visual and audio warnings for out-of-view objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If robotic arms are used in minimally invasive surgery, then surgical precision and automation are improved, but the ability to directly measure surgical site characteristics is lost
Solution Approach 1:
The patent introduces image processing algorithms as an intermediary between the robotic system and the surgical site. Multiple 2D images captured by robotic arms are processed to reconstruct 3D anatomical structures, enabling indirect measurement of surgical site characteristics without direct physical contact. This mediator bridges the gap between automated robotic operation and the need for precise measurement data.
Solution Approach 2:
The patent replaces direct mechanical measurement devices with optical imaging and computational methods. Instead of using physical probes or contact-based measurement tools that would interfere with minimally invasive procedures, the system uses image capture and 3D reconstruction algorithms to obtain measurement data, substituting mechanical measurement with optical and computational approaches.
2Device complexity
If 2D images are used to represent 3D anatomical structures, then image capture is simplified, but spatial relationships and depth information are lost
Solution Approach 1:
The patent transforms 2D image data into 3D spatial representations through computational reconstruction algorithms. By processing multiple 2D images from different angles and applying stereo vision principles, the system recovers depth information and reconstructs three-dimensional anatomical structures, effectively adding the missing dimension back to the data.
Solution Approach 2:
The patent performs preliminary 3D reconstruction of anatomical structures before surgical measurements are taken. By pre-processing the image data to create accurate 3D models of the surgical site, the system establishes a comprehensive spatial framework in advance, enabling subsequent measurements to be performed with full three-dimensional context and improving overall measurement accuracy.
Data Source
Figure 1
Figure 2
Figure 3~4
AI summary
A computer-implemented method of object enhancement in endoscopy images includes capturing an image of an object within a surgical operative site via an imaging device, determining a size of the object based on the captured image of the object, displaying the captured image of the object, and displaying on the displayed captured image of the object a representation of the determined size of the object.