Catheter Tip Localization via X-Ray to 3D Ultrasound Registration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In cardiac interventional procedures, accurately visualizing the tip of a catheter and its orientation within 3D ultrasound images is challenging, as existing methods rely heavily on X-ray fluoroscopy and require multiple sensors for 3D shape tracking, which can be cumbersome and less effective in real-time ultrasound guidance.

Innovation Solution

An image-guided system that combines X-ray imaging with 3D ultrasound to track the catheter tip, using a tool tracking device that localizes the catheter tip within the ultrasound image based on X-ray image identification, and employs graph cut segmentation to visualize the catheter's 3D shape in real-time, integrating X-ray/3D US registration for precise alignment and segmentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple position sensors and shape sensing sensors are mounted on the interventional tool to track the 3D shape in real time, then the visualization completeness of the tool shape is improved, but the device complexity and ease of operation deteriorate

Engineering Contradiction:
Improvevisualization completeness of tool shapeVSAvoidnumber of sensors
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent extracts only the essential information needed for visualization by identifying the catheter tip in X-ray images and mapping it to 3D US space, rather than tracking the entire catheter shape with multiple sensors. This extraction approach maintains visualization completeness for the critical tip region while eliminating the need for complex multi-sensor systems.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a virtual model of the catheter tip by mapping coordinates from X-ray fluoroscopy to 3D ultrasound space, generating a visual representation without physical sensors on the catheter. This copying approach allows shape visualization through computational geometry rather than physical sensing.

Inventive Principle:
Principle #26Copying

2Measurement precision

If X-ray fluoroscopy is used to provide high resolution visualization of the interventional tool, then the measurement precision is improved, but the ability to provide real time motion information deteriorates

Engineering Contradiction:
Improveresolution of tool visualizationVSAvoidreal time motion information
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The patent merges X-ray fluoroscopy and 3D ultrasound imaging modalities by registering their coordinate systems and combining their strengths. X-ray provides high-resolution tip localization while 3D US provides real-time volumetric context and motion tracking, creating a hybrid system that achieves both precision and speed.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses coordinate transformation and image registration as intermediary processes to translate X-ray fluoroscopy data into the 3D ultrasound coordinate system. This intermediary mapping allows high-resolution X-ray tip detection to inform real-time 3D US visualization without requiring direct X-ray streaming at full resolution.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If 2D or 3D ultrasound is registered with X-ray imaging to augment fluoroscopy, then the real time motion information is improved, but the device complexity increases

Engineering Contradiction:
Improvereal time motion informationVSAvoidimage registration system
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent implements a universal coordinate registration system that handles both 2D and 3D ultrasound images with X-ray fluoroscopy through a unified mathematical transformation framework. This multi-functional registration approach accommodates different imaging modalities without requiring separate complex registration procedures for each type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

4Measurement precision

If the catheter tip is identified in X-ray images and mapped into 3D US, then the localization accuracy is improved, but the difficulty of detecting and measuring increases

Engineering Contradiction:
Improvecatheter tip localization accuracyVSAvoidtip identification complexity
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The system uses the inherent radiopaque features of the catheter tip visible in X-ray images as self-identifying markers, eliminating the need for external fiducial markers or complex recognition algorithms. The catheter's own structural features serve as the detection target, simplifying the identification process while maintaining high localization accuracy.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9993304B2Visualization of catheter of three-dimensional ultrasound
Publication Date: 2018.06.12 KONINKLIJKE PHILIPS NV
  • US9993304B2 patent drawing
  • US9993304B2 patent drawing
  • US9993304B2 patent drawing

AI summary

An image-guided system includes an X-ray imaging device for generating one or more X-ray images illustrating a tool within an anatomical region, and an ultrasound imaging device for generating an ultrasound image illustrating the tool within the anatomical region. The image-guided system further includes a tool tracking device for visually tracking the tool within the anatomical region. In operation, the tool tracking device localizes a portion of the tool as located within the ultrasound image responsive to an identification of the portion of the tool as located within the X-ray image(s), and executes an image segmentation of an entirety of the tool as located within the ultrasound image relative to a localization of the portion of the tool as located within the ultrasound image.