Augmented Reality Endoscope for Blood Perfusion Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing minimally invasive surgical tools, including endoscopes and displays, have limited ability to identify conditions or objects within the field of view that are not fully visible in the spectrum shown during surgery, such as blood perfusion, requiring additional methods like adding taggants to the patient's bloodstream.
Innovation Solution
An augmented reality surgical system that includes an endoscope and an electrocardiogram (ECG) device, using image processing filters to generate an augmented image by decomposing and reconstructing image frames, amplifying specific frequency bands, and combining with ECG data to enhance visibility of tissue perfusion and blood flow.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional endoscopes and displays are used during minimally invasive surgery, then the surgical procedure can be performed with small incisions, but the ability to identify blood perfusion and tissue conditions is limited
Solution Approach 1:
The system changes the parameter of light wavelength by using multiple specific wavelengths (e.g., 660nm for arterial blood, 940nm for venous blood) to differentially detect arterial and venous perfusion. This allows the same endoscope to provide multiple types of perfusion information by simply changing which wavelength is analyzed, without adding separate devices for each function.
Solution Approach 2:
The endoscope system is designed to perform multiple functions: standard visual imaging, arterial perfusion detection, venous perfusion detection, and combined perfusion assessment. By integrating multiple wavelength detection capabilities into a single endoscope system, the patent achieves multi-functionality without requiring separate specialized devices for each type of tissue assessment.
2Measurement precision
If taggants are added to the patient's bloodstream to identify blood perfusion, then perfusion detection becomes possible, but the procedure becomes more complex and invasive
Solution Approach 1:
The system utilizes the patient's own blood as the detection target without requiring any external additives. The blood's natural optical properties at different wavelengths provide the necessary contrast for detecting arterial and venous perfusion. This self-service approach eliminates the need for taggants or contrast agents, reducing invasiveness while maintaining detection capability.
Solution Approach 2:
Light serves as the intermediary between the endoscope and the blood perfusion being detected. By using light of specific wavelengths that interact differently with arterial and venous blood, the system can detect perfusion without physical contact or injection of substances into the bloodstream. The light acts as a non-invasive mediator that carries information about blood flow and oxygenation.
3Loss of information
If the full spectrum of light is captured by the endoscope, then more information is available, but the display cannot show all information simultaneously
Solution Approach 1:
The system segments the captured light spectrum into distinct wavelength bands (e.g., 660nm for arterial, 940nm for venous) and processes each band separately to extract specific perfusion information. This segmentation allows the display to show different types of perfusion data in a structured manner, making the information visible without requiring the display to show the entire spectrum simultaneously.
Solution Approach 2:
The system transforms the spectral information from the captured light into a different dimensional representation on the display. Instead of showing the full spectrum as a continuous range, the system maps specific wavelength information to different visual parameters (such as color overlays, brightness adjustments, or separate display channels), allowing multiple types of perfusion information to be visualized simultaneously in a comprehensible format.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables clinicians to identify subtle changes in tissue perfusion and blood flow in real-time, reducing the need for additional procedures and ensuring the effectiveness of surgical outcomes without modifying existing endoscopes or adding taggants.
Implementation Method 1
The endoscope may emit light having a wavelength that is selectively absorbed or reflected by arterial blood and/or venous blood
Implementation Method 2
The image processing filter includes a decomposition filter configured to decompose the image into a plurality of frequency bands, a temporal filter that is configured to be applied to the plurality of frequency bands
Implementation Method 3
an electrocardiogram (ECG) device configured to record electrical activity of a heart of the patient
Data Source
AI summary
The present disclosure is directed to an augmented reality surgical system. The system includes an endoscope that captures an image of the region of interest of a patient and an ECG device that records an ECG of the patient. A controller receives the image and applies at least one image processing filter to the image. The image processing filter includes a decomposition filter that decomposes the image into frequency bands. A temporal filter is applied to the frequency bands to generate temporally filtered bands. An adder adds each band frequency band to a corresponding temporally filtered band to generate augmented bands. A reconstruction filter generates an augmented image by collapsing the augmented bands. The controller also receives the ECG and processes the augmented image with the ECG to generate an ECG filtered augmented image. A display displays the ECG filtered augmented image to a user.