Automatic Ultrasound Image Correlation via Feature-Based Transformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The ability to fuse or correlate ultrasound data with data from other image modalities, such as CT or MRI, is challenging due to the need for manual alignment, which is time-intensive and prone to human error, especially when aligning images acquired at different times.

Innovation Solution

A method and system for automatically generating a transformation matrix to correlate ultrasound images with images from other modalities, allowing for real-time alignment and fusion of images from different modalities without manual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual alignment is used to correlate ultrasound images with images from other modalities, then the alignment can be performed with existing technology, but the process becomes time-intensive and prone to human error

Engineering Contradiction:
Improvealignment accuracyVSAvoidalignment time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs self-alignment by automatically identifying corresponding features between ultrasound images and other modality images, and autonomously computing the transformation matrix without requiring manual intervention from technicians

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical alignment process with an automated computational system that uses feature detection algorithms and mathematical transformations to achieve precise image correlation

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If manual alignment is used to generate transformation matrix, then the process can be performed with existing technology, but it introduces human error and requires expertise in interpreting both image modalities

Engineering Contradiction:
Improvealignment reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system autonomously identifies corresponding anatomical features between different image modalities and automatically computes the transformation matrix, eliminating human error while maintaining interpretability through standardized algorithms

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces an automated feature correlation component as an intermediary that bridges ultrasound images and other modality images, using detectable features as mediators to establish accurate spatial relationships without direct human intervention

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If automatic transformation matrix generation is implemented, then alignment speed and accuracy improve, but the system complexity increases

Engineering Contradiction:
Improvealignment efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the image correlation process into distinct modular components: feature detection module, feature matching module, and transformation matrix computation module, allowing each to be optimized independently while maintaining overall system efficiency

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The automated feature correlation component serves as an intelligent intermediary that simplifies the overall process by handling the complex computational tasks of feature identification and transformation, making the system more efficient despite increased internal complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8744211B2Multi-modality image acquisition
Publication Date: 2014.06.03 ANALOGIC CORP
  • US8744211B2 patent drawing
  • US8744211B2 patent drawing
  • US8744211B2 patent drawing

AI summary

One or more techniques and/or systems are described for automatically generating a transformation matrix for correlating images from an ultrasound modality with images from another modality (or with ultrasound images acquired at a different point in time). Ultrasound volumetric data and volumetric data yielded from another image modality are examined to identify and/or extract features. The transformation matrix is automatically generated, or populated, based at least in part upon common features that are identified in both the ultrasound volumetric data and the volumetric data yielded from the other image modality. The transformation matrix can then be used to correlate images from the different modalities (e.g., to display a CT image of an object next to an ultrasound image of the object, where the images are substantially similar to one another even though they were acquired using different modalities).