Endoscope IR Optical Imaging for 3D Surgical Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging techniques during minimally-invasive surgical procedures lack effective methods for generating robust 3D images from 2D and 3D data, limiting clinicians' ability to accurately visualize anatomical features and navigate surgical instruments within the body.

Innovation Solution

The system combines an endoscope with an infrared (IR) light source and camera to capture IR images and an optical light source and camera to capture optical images, associating these to generate intra-operative 3D images, which are then displayed and potentially integrated with pre-operative images to create a 3D model, aiding in surgical navigation and visualization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple imaging modalities (IR and optical cameras) are integrated into the endoscope system, then the visualization capability and 3D image quality are improved, but the device complexity increases

Engineering Contradiction:
Improvevisualization accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple imaging modalities (infrared camera, optical camera, and light sources) into a single integrated endoscope system. The infrared light source and camera are merged with the optical light source and camera within the same endoscope housing, allowing simultaneous capture of IR and optical images from the same surgical site. This merging approach improves measurement precision by providing multi-modal data from identical locations while managing device complexity through integrated design.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The endoscope system is designed with multi-functionality by incorporating both infrared and optical imaging capabilities within a single device. The system can perform both thermal/structural imaging (IR) and standard visual imaging (optical) using one endoscope, eliminating the need for separate imaging devices. This universal approach enhances visualization accuracy across different tissue types and conditions while reducing the overall number of components required.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If 3D image generation is implemented from multiple 2D images, then the anatomical visualization is improved, but the processing time and computational complexity increase

Engineering Contradiction:
Improveanatomical visualization accuracyVSAvoidimage processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing synchronized IR and optical images simultaneously during the surgical procedure. The images are captured in real-time as the endoscope moves through the body, and the association between corresponding points in the two image sets is established during the imaging process itself. This preliminary capture and association of data enables faster 3D reconstruction later, as the matching work is partially done during data acquisition rather than requiring extensive post-processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a virtual 3D model as a copy or representation of the actual anatomical structures by mapping corresponding points between 2D IR and optical images. The 3D model is generated by triangulating the spatial relationships between features visible in both image modalities, creating an accurate virtual replica of the surgical site anatomy. This copying approach allows clinicians to visualize complex 3D structures from 2D image data without requiring physically complex 3D imaging hardware.

Inventive Principle:
Principle #26Copying

3Measurement precision

If IR light beams are projected in a grid pattern onto anatomical features, then the 3D coordinate determination is improved, but the light energy consumption increases

Engineering Contradiction:
Improve3D coordinate accuracyVSAvoidlight energy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system uses a grid pattern of IR light beams that provides sufficient (excessive) illumination coverage to ensure accurate 3D coordinate determination, but the grid spacing and beam intensity are optimized to use only the necessary amount of energy. The grid pattern ensures that enough light reaches the anatomical features for precise spatial mapping without wasting energy on excessive illumination. This partial/excessive action approach guarantees measurement precision while managing energy consumption efficiently.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances visualization of anatomical features and surgical tool positioning, improving navigation and diagnosis during minimally-invasive procedures by providing accurate and detailed 3D models of the surgical site.

Implementation Method 1

an infrared (IR) light source configured to project a plurality of IR light beams onto at least one anatomical feature, an IR camera configured to capture a first image, the first image including a reflection of the plurality of IR light beams

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

an optical light source configured to project optical light onto the at least one anatomical feature, and an optical camera configured to capture a second image, the second image including at least one anatomical feature illuminated by the optical light source

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS11730562B2Systems and methods for imaging a patient
Publication Date: 2023.08.22 COVIDIEN LP
  • US11730562B2 patent drawing
  • US11730562B2 patent drawing
  • US11730562B2 patent drawing

AI summary

Systems and methods of imaging include projecting infrared (IR) light from the endoscope toward the at least one anatomical feature (e.g., the exterior of a liver or lung), capturing the IR light, projecting optical light from the endoscope toward a similar portion of the anatomical feature, and capturing the optical light. Once the IR light and the optical light are captured, both are associated with one another to generate an intra-operative 3D image. This projection and capture of IR and optical light may occur at discrete times during the imaging process, or simultaneously.