Multimodal Device Tracking for X-Ray and 3D Ultrasound Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing medical imaging systems, particularly ultrasound imaging, struggle with device visibility due to shadowing, reflection, and acoustic artifacts, making it difficult to accurately track and interpret devices during procedures like transcatheter Structural Heart Interventions.
Innovation Solution
A system that combines 2D X-ray and 3D ultrasound image data through co-registration, using identification information from X-ray images to enhance 3D ultrasound views, allowing for accurate device tracking and visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If ultrasound imaging is used to visualize medical devices, then soft-tissue anatomy can be visualized, but device visibility is reduced due to shadowing, reflection, and acoustic artifacts
Solution Approach 1:
The patent combines ultrasound image data with X-ray image data into a fused image that displays both soft-tissue anatomy from ultrasound and device visibility from X-ray. The processing unit overlays device information from X-ray images onto ultrasound images, creating a composite view that eliminates the visibility problems of using either modality alone.
2Area of stationary object
If a device is captured partially outside the limited field of view of ultrasound imaging, then the field of view constraint is acknowledged, but proper interpretation and optimal viewing become difficult
Solution Approach 1:
The patent uses X-ray imaging, which provides a different dimensional perspective (projection view) compared to ultrasound's limited acoustic field of view. By fusing these complementary views, the system recovers device information that would otherwise be lost due to ultrasound's field of view constraints.
3Illumination intensity
If 2D X-ray image data is used to identify devices, then device footprint visibility is high, but 3D position and orientation information is limited
Solution Approach 1:
The patent merges 2D X-ray device footprint information with 3D ultrasound spatial data to create a fused image that preserves the high device visibility of X-ray while adding accurate 3D position and orientation information from ultrasound imaging.
Data Source
AI summary
The present invention relates to supporting an interventional procedure involving a device, such as a cardiovascular procedure. First and second image data acquired using different imaging apparatus, for example X-ray and ultrasound image data, are co-registered. A device is firstly identified in 2D X-ray images; corresponding identification information is then used to generate a view from 3D ultrasound image data that includes a cross-section of the device to be identified subsequently. Following the identification, a 3D position and orientation of the device are available. Such information may advantageously be used in setting up optimal ultrasound views for image-based guidance of the ongoing procedure.