Endoscopic 3D Imaging Using Augmented Parallax and Multi-IR Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current monocular and binocular optical devices used in minimally invasive surgery provide limited depth information due to restricted parallax, affecting the accuracy of distance measurement between surgical tools and anatomical features.
Innovation Solution
A system utilizing multiple IR cameras positioned on separate surgical instruments and a scanner to capture IR light, determining parallax and generating an integrated 3D image by associating IR and optical light images, allowing for enhanced depth perception.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple IR cameras are positioned on separate surgical instruments, then depth accuracy and parallax are improved, but device complexity increases
Solution Approach 1:
The system divides the imaging function across multiple separate surgical instruments, each equipped with its own IR camera. This segmentation allows each camera to capture images from distinct spatial positions, enabling accurate parallax-based depth measurement while distributing the system complexity across multiple independent components rather than requiring a single complex integrated system.
Solution Approach 2:
The patent transitions from traditional single-point or limited-angle imaging to multi-dimensional spatial distribution of cameras across separate surgical instruments. By positioning cameras in three-dimensional space around the surgical field, the system captures depth information from multiple angles simultaneously, converting a limited 2D imaging problem into a rich 3D spatial measurement system.
2Reliability
If multiple IR cameras with overlapping fields of view are used, then blind spots are reduced, but device complexity increases
Solution Approach 1:
The system merges the fields of view from multiple IR cameras positioned on separate surgical instruments to create a comprehensive integrated view of the surgical field. By combining overlapping fields of view, the system eliminates blind spots and ensures complete coverage of anatomical structures and surgical instruments from multiple perspectives simultaneously.
3Productivity
If real-time 3D image generation is performed, then surgical feedback is improved, but processing time and complexity increase
Solution Approach 1:
The system performs preliminary actions by continuously capturing and pre-processing images from multiple IR cameras in real-time during the surgical procedure. Depth information and parallax calculations are computed continuously as new images are captured, preparing the data for immediate 3D reconstruction and surgical feedback without requiring post-procedure processing.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system provides accurate, real-time 3D imaging with reduced blind spots and improved depth accuracy by leveraging wide parallax and overlapping fields of view from multiple cameras.
Implementation Method 1
capturing IR light reflected off of an anatomical object with at least two IR cameras
Data Source
Figure 1A~1B
Figure 2
Figure 3A
AI summary
A method for imaging involves scanning an anatomical object within a patient and capturing reflected IR light with a plurality of cameras that are separate from the scanner. The IR images captured by the IR cameras are associated together to create an integrated image based on parallax between the IR cameras and the scanner. The integrated image is associated with a separate or optical light image of the anatomical object to generate an intra-operative 3D image that can be created in real-time. Systems for effectuating such imaging may include multiple surgical instruments supporting various cameras positioned to capture different fields of view and to increase parallax.