Image-Based Instrument Navigation Using Ultrasound and EM Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging systems, such as echocardiography and fluoroscopy, are difficult to use and interpret, especially for minimally-invasive medical procedures, leading to challenges in visualizing cardiac tissue and exposing patients and staff to radiation.

Innovation Solution

A system combining ultrasound imaging and electromagnetic tracking to generate a graphical user interface that overlays anatomical markers and target zones, allowing clinicians to guide instruments accurately without real-time fluoroscopic images, using machine learning and image fusion to maintain visibility of anatomical landmarks even when obstructed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If fluoroscopic imaging is used throughout the procedure to visualize catheter location, then the physician can see the location of instruments in real-time, but the patient and staff are exposed to radiation and contrast agents

Engineering Contradiction:
Improvereal-time instrument location visualizationVSAvoidradiation exposure to patient and staff
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary actions by acquiring complete 3D anatomical images before the procedure and creating virtual models of the patient's cardiovascular structures. These pre-acquired images are then used throughout the procedure to guide instrument placement without requiring continuous fluoroscopic imaging, thereby reducing radiation exposure while maintaining visualization capability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a virtual copy of the patient's cardiovascular anatomy through pre-procedure 3D imaging and computational modeling. This virtual model serves as a radiation-free substitute for real-time fluoroscopic imaging, allowing physicians to track instrument positions and visualize anatomical structures without exposing patients and staff to ionizing radiation

Inventive Principle:
Principle #26Copying

2Loss of information

If fluoroscopy is used to visualize blood with contrast dye, then catheter location can be determined, but fluoroscopy does not visualize cardiac tissue well and requires contrast agents

Engineering Contradiction:
Improvecatheter and blood vessel visualizationVSAvoidcardiac tissue visualization quality
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system merges multiple imaging modalities and data sources, combining pre-procedure 3D anatomical imaging with real-time instrument tracking technology. This integration creates a comprehensive navigation system that simultaneously provides both blood vessel/catheter visualization and detailed cardiac tissue imaging without relying on contrast agents

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The navigation system performs multiple functions: it visualizes blood vessels and catheter positions, images cardiac tissue in detail, tracks instrument locations in real-time, and provides 3D spatial orientation. This multi-functional system replaces the limited capabilities of fluoroscopy, which can only visualize blood vessels with contrast dye but cannot adequately image cardiac tissue

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If echocardiography is used for imaging during procedures, then real-time cardiac structure visualization is possible, but the system is difficult to use and interpret with poor image quality

Engineering Contradiction:
Improvereal-time cardiac structure imagingVSAvoidimage interpretation difficulty
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system replaces the complex mechanical and interpretive requirements of echocardiography with an automated computer-based navigation system. The system automatically processes imaging data, generates 3D reconstructions, and provides intuitive visual guidance, eliminating the need for clinicians to manually interpret difficult echocardiographic images while maintaining real-time cardiac structure visualization

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Object-affected harmful factors

If minimally-invasive techniques are used for device implantation, then patient trauma is reduced, but the clinician does not have a line-of-sight view of the patient's heart during implantation

Engineering Contradiction:
Improvepatient trauma from open heart surgeryVSAvoiddirect visual access to heart during procedure
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The navigation system acts as an intermediary that bridges the gap between minimally-invasive access and direct visual observation. It uses pre-acquired 3D anatomical images and real-time instrument tracking to create a virtual line-of-sight to the heart, allowing clinicians to perform minimally-invasive procedures with the same level of anatomical awareness as if they had direct visual access through open surgery

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances visualization of anatomical landmarks and instrument positioning during procedures, reducing radiation exposure and improving the accuracy of minimally-invasive surgeries by providing continuous guidance through augmented reality.

Implementation Method 1

an ultrasound sensor configured to collect ultrasound image data

Methodology Applied
Scientific EffectUltrasound: Ultrasound

Implementation Method 2

an electromagnetic (EM) tracking system configured to collect EM tracking data representative of positions and orientations of each of the ultrasound sensor and the instrument

Methodology Applied
Scientific EffectElectromagnetic tracking: Electromagnetic Induction

Data Source

PatentUS12383340B2Image-based navigation system and method of using same
Publication Date: 2025.08.12 MEDTRONIC INC
  • US12383340B2 patent drawing
  • US12383340B2 patent drawing
  • US12383340B2 patent drawing

AI summary

Various embodiments of a system for guiding an instrument through a region of a patient are disclosed. The system includes an instrument and a controller that is adapted to receive ultrasound image data from an ultrasound sensor, receive EM tracking data from an EM tracking system, and identify a physiological landmark of the region of the patient based on the ultrasound image data. The controller is further adapted to determine at least one of a position, orientation, or trajectory of the instrument based on the EM tracking data and generate a graphical user interface showing at least one of the position, orientation, or trajectory of the instrument in relation to a plane of the ultrasound image data, and a target zone that is registered with the physiological landmark.