Guided Feature Matching for Deformable Image Registration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current deformable image registration (DIR) evaluation methods are inadequate for accurately assessing DIR accuracy due to reliance on manual landmark selection, which is labor-intensive and subjective, and existing automatic methods like SIFT feature detection and matching are not mature enough to reliably verify DIR results on arbitrary patient datasets, failing to detect sufficient feature pairs with high accuracy.

Innovation Solution

A computer-implemented method using a multi-resolution pyramid scheme and guided feature matching to detect and match landmark pairs in full-resolution images, employing down-sampling to reduce noise and improve feature detection and matching accuracy, with a combination of SIFT and Harris-Laplacian corner detectors, and inverse-consistent matching to enhance accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual landmark selection is used for DIR evaluation, then DIR accuracy can be assessed, but the process becomes very labor intensive and time consuming

Engineering Contradiction:
ImproveDIR accuracy assessmentVSAvoidlandmark selection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables automatic landmark detection and pairing through image processing algorithms that identify anatomical structures autonomously without requiring manual operator intervention. The algorithm processes medical images to automatically detect and match corresponding landmarks across different imaging modalities or time points, eliminating the need for manual landmark selection while maintaining assessment accuracy.

Inventive Principle:
Principle #25Self-service

2Extent of automation

If automatic feature detection methods like SIFT are used, then landmark detection can be automated, but the accuracy and reliability of feature pair matching is insufficient

Engineering Contradiction:
Improvelandmark detection automationVSAvoidfeature pair matching accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The system introduces an intermediary registration transformation step that bridges automatic feature detection and accurate landmark pairing. The method performs initial image registration to align anatomical structures, then uses the registered image pairs to guide more accurate landmark detection and matching. This intermediary registration process corrects misalignments that would otherwise cause inaccurate feature pair matching, enabling both automation and high precision.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Quantity of substance

If a large number of landmarks are manually selected to improve assessment coverage, then DIR evaluation becomes more comprehensive, but the labor intensity increases significantly

Engineering Contradiction:
Improvenumber of landmarksVSAvoidevaluation efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The automatic landmark detection system can identify and process a large number of landmarks across the entire image volume without additional manual effort. The algorithm systematically detects anatomical structures throughout the medical images, generating comprehensive landmark sets that cover the full assessment region, thereby achieving both high coverage and maintained productivity.

Inventive Principle:
Principle #25Self-service

4Ease of operation

If manual landmark selection focuses on visually apparent features, then landmark detection is easier, but the selection becomes subjective and biased toward regions with strong image gradients

Engineering Contradiction:
Improvelandmark detection easeVSAvoidlandmark selection objectivity
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The automated algorithm objectively detects landmarks based on image intensity patterns and anatomical structure characteristics without human subjective judgment. The system systematically identifies corresponding structures across images using consistent computational criteria, eliminating observer bias and ensuring reproducible, objective landmark selection across different cases and operators.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11010630B2Systems and methods for detecting landmark pairs in images
Publication Date: 2021.05.18 WASHINGTON UNIV IN SAINT LOUIS
  • US11010630B2 patent drawing
  • US11010630B2 patent drawing
  • US11010630B2 patent drawing

AI summary

A computer-implemented method for detecting landmark pairs in a pair of images is provided. The method includes receiving a pair of images, sampling the pair of images to generate reduced-resolution pairs of images, identifying features in the reduced-resolution pairs of images, matching the features in the image pairs, using the matched features in an increased resolution pair of images as guides for feature matching, and through iteratively guiding feature matching, identifying landmarks in the full-resolution pair of images.