Surgical Imaging 3D Mapping With Special-Light SLAM
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing medical observation systems, such as endoscopes and microscopes, face challenges in discerning blood vessels or lesions at deep parts using visible light, as they are difficult to see and require special light imaging, which complicates three-dimensional information generation.
Innovation Solution
The system employs special light SLAM (Simultaneous Localization and Mapping) using infrared, bluish, high transmissivity, polarized, or pulse-modulated light to generate a three-dimensional map, emphasizing features like blood vessels, and combines this with visible light SLAM for enhanced reliability.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If special light imaging is used to discern deep structures, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent combines multiple imaging modalities (visible light endoscopy and infrared thermography) into a single integrated system. The endoscope and infrared camera are positioned to capture images of the same surgical field simultaneously, merging their functional capabilities to provide both anatomical visualization and thermal information without requiring separate complex systems
Solution Approach 2:
The imaging system is designed to perform multiple functions using a single integrated apparatus. The system can switch between visible light imaging for anatomical structure observation and infrared imaging for thermal detection of deep structures and blood vessels, making the device versatile and reducing overall system complexity
2Measurement precision
If special light imaging is used to emphasize deep structures, then measurement precision is improved, but ease of operation deteriorates
Solution Approach 1:
The system merges visible light images and infrared thermal images into a single composite display. The overlay technique combines the anatomical reference from visible light with the thermal information from infrared imaging, allowing operators to interpret deep structure information in the context of surface anatomy, thereby simplifying image interpretation
Solution Approach 2:
The visible light image serves as an intermediary that provides anatomical context and reference for interpreting the infrared thermal information. By overlaying the infrared data on the familiar visible light anatomy, the system creates a bridge that makes the interpretation of deep thermal structures more intuitive and easier for operators
3Reliability
If combination SLAM is used to generate three-dimensional information, then reliability is improved, but device complexity increases
Solution Approach 1:
The system merges feature detection from both visible light and infrared images into a unified SLAM processing pipeline. By combining feature points detected from multiple imaging modalities, the system creates more robust three-dimensional spatial information that is reliable even when individual modalities encounter challenging conditions
Solution Approach 2:
The SLAM system continuously updates the three-dimensional map and provides feedback for navigation and positioning. The combination of multiple image sources provides redundant information that enhances the reliability of the feedback loop, allowing the system to maintain accurate spatial awareness despite the increased processing complexity
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach provides highly reliable three-dimensional information by emphasizing deep structures and reducing the impact of surgical field changes, ensuring accurate navigation and visualization during surgeries.
Implementation Method 1
irradiating the surgical field with special light of a wavelength band different from that of visible light (white light), and images during the irradiation with the special light are captured
Implementation Method 2
obtain a three-dimensional map on the basis of a special light image
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A medical imaging system includes a light source configured to irradiate a surgical field with observation light of a first wavelength band or special light of a second wavelength band different from the first wavelength band; an image capture device configured to generate a special light image based on reflected special light that is the special light reflected from at least a portion of the surgical field and received by the image capture device; and a control processing circuit configured to generate three-dimensional information including three-dimensional coordinate information about the surgical field based on the special light image.