Predictive Image Fusion via Spatial Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing medical image fusion technologies face challenges in accurately registering and aligning images from different modalities, such as MRI and ultrasound, due to significant variations in the orientation of anatomical features across these modalities.

Innovation Solution

An image fusion system that uses a spatial tracker to detect and track the position and orientation of an imaging device, allowing for the prediction and synchronization of image alignment between different modalities. This system determines a predicted pose of anatomical features based on feature information from previously acquired images and maintains alignment even when the imaging device moves during a procedure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If images from different modalities are fused without spatial tracking, then the process is simpler and faster, but the alignment accuracy between anatomical features deteriorates

Engineering Contradiction:
Improvealignment accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

A spatial tracker is introduced as an intermediary device to detect and track anatomical features across different imaging modalities. The tracker establishes a reference frame that mediates between images from different sources, enabling accurate alignment without requiring complex direct registration algorithms between the modalities themselves.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The spatial tracker performs preliminary detection and tracking of anatomical features before the actual image fusion process. By pre-establishing the spatial relationship and orientation of features from multiple modalities, the system prepares alignment information in advance, which then simplifies the subsequent fusion process while maintaining high accuracy.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the imaging device is stationary during imaging, then the alignment is easier to establish, but the system cannot maintain alignment when the device moves during procedures

Engineering Contradiction:
Improvealignment maintenanceVSAvoiddevice mobility
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The spatial tracking system transitions from a static alignment model to a dynamic one. The tracker continuously monitors the position and orientation of anatomical features in real-time, allowing the system to adapt to device movement and maintain accurate alignment throughout the procedure rather than requiring the device to remain stationary.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The spatial tracker provides continuous feedback on the current spatial relationship between the imaging device and anatomical features. This feedback loop enables the system to detect deviations from the expected alignment and automatically adjust or alert the operator, ensuring reliable alignment maintenance even during device movement.

Inventive Principle:
Principle #23Feedback

3Productivity

If manual registration is used to align images, then the system is more flexible and adaptable, but the time required for registration increases significantly

Engineering Contradiction:
Improveregistration speedVSAvoidalignment accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The manual mechanical process of visual inspection and manual adjustment is replaced with an automated computational system. The spatial tracker uses algorithms to automatically detect, track, and register anatomical features across different modalities, substituting the manual mechanical registration process with automated computational methods that are both faster and more precise.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12266120B2System and method for predictive fusion
Publication Date: 2025.04.01 MIM SOFTWARE INC
  • US12266120B2 patent drawing
  • US12266120B2 patent drawing
  • US12266120B2 patent drawing

AI summary

An image fusion system provides a predicted alignment between images of different modalities and synchronization of the alignment, once acquired. A spatial tracker detects and tracks a position and orientation of an imaging device within an environment. A predicted pose of an anatomical feature can be determined, based on previously acquired image data, with respect to a desired position and orientation of the imaging device. When the imaging device is moved into the desired position and orientation, a relationship is established between the pose of the anatomical feature in the image data and the pose of the anatomical feature imaged by the imaging device. Based on tracking information provided by the spatial tracker, the relationship is maintained even when the imaging device moves to various positions during a procedure.