Endoscope IR Optical Imaging for 3D Surgical Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current imaging techniques during minimally-invasive surgical procedures lack effective methods for generating robust 3D images from 2D and 3D data, limiting clinicians' ability to accurately visualize anatomical features and navigate surgical instruments within the body.
Innovation Solution
The system combines an endoscope with an infrared (IR) light source and camera to capture IR images and an optical light source and camera to capture optical images, associating these to generate intra-operative 3D images, which are then displayed and potentially integrated with pre-operative images to create a 3D model, aiding in surgical navigation and visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple imaging modalities (IR and optical cameras) are integrated into the endoscope system, then the visualization capability and 3D image quality are improved, but the device complexity increases
Solution Approach 1:
The patent combines multiple imaging modalities (infrared camera, optical camera, and light sources) into a single integrated endoscope system. The infrared light source and camera are merged with the optical light source and camera within the same endoscope housing, allowing simultaneous capture of IR and optical images from the same surgical site. This merging approach improves measurement precision by providing multi-modal data from identical locations while managing device complexity through integrated design.
Solution Approach 2:
The endoscope system is designed with multi-functionality by incorporating both infrared and optical imaging capabilities within a single device. The system can perform both thermal/structural imaging (IR) and standard visual imaging (optical) using one endoscope, eliminating the need for separate imaging devices. This universal approach enhances visualization accuracy across different tissue types and conditions while reducing the overall number of components required.
2Measurement precision
If 3D image generation is implemented from multiple 2D images, then the anatomical visualization is improved, but the processing time and computational complexity increase
Solution Approach 1:
The system performs preliminary actions by capturing synchronized IR and optical images simultaneously during the surgical procedure. The images are captured in real-time as the endoscope moves through the body, and the association between corresponding points in the two image sets is established during the imaging process itself. This preliminary capture and association of data enables faster 3D reconstruction later, as the matching work is partially done during data acquisition rather than requiring extensive post-processing.
Solution Approach 2:
The patent creates a virtual 3D model as a copy or representation of the actual anatomical structures by mapping corresponding points between 2D IR and optical images. The 3D model is generated by triangulating the spatial relationships between features visible in both image modalities, creating an accurate virtual replica of the surgical site anatomy. This copying approach allows clinicians to visualize complex 3D structures from 2D image data without requiring physically complex 3D imaging hardware.
3Measurement precision
If IR light beams are projected in a grid pattern onto anatomical features, then the 3D coordinate determination is improved, but the light energy consumption increases
Solution Approach 1:
The system uses a grid pattern of IR light beams that provides sufficient (excessive) illumination coverage to ensure accurate 3D coordinate determination, but the grid spacing and beam intensity are optimized to use only the necessary amount of energy. The grid pattern ensures that enough light reaches the anatomical features for precise spatial mapping without wasting energy on excessive illumination. This partial/excessive action approach guarantees measurement precision while managing energy consumption efficiently.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances visualization of anatomical features and surgical tool positioning, improving navigation and diagnosis during minimally-invasive procedures by providing accurate and detailed 3D models of the surgical site.
Implementation Method 1
an infrared (IR) light source configured to project a plurality of IR light beams onto at least one anatomical feature, an IR camera configured to capture a first image, the first image including a reflection of the plurality of IR light beams
Implementation Method 2
an optical light source configured to project optical light onto the at least one anatomical feature, and an optical camera configured to capture a second image, the second image including at least one anatomical feature illuminated by the optical light source
Data Source
AI summary
Systems and methods of imaging include projecting infrared (IR) light from the endoscope toward the at least one anatomical feature (e.g., the exterior of a liver or lung), capturing the IR light, projecting optical light from the endoscope toward a similar portion of the anatomical feature, and capturing the optical light. Once the IR light and the optical light are captured, both are associated with one another to generate an intra-operative 3D image. This projection and capture of IR and optical light may occur at discrete times during the imaging process, or simultaneously.


