Deformable Image Registration via Multi-Scale Markov Fields

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current deformable image registration methods fail to accurately handle discontinuities in deformation fields, leading to errors in medical applications such as image-guided radiation therapy due to their assumption of smooth deformations.

Innovation Solution

A multi-scale discrete optimization approach is used, reducing the number of labels by considering a constant number of labels at each scale, starting with coarse deformations and refining to subpixel or subvoxel levels, coupled with a regularization term to handle smoothness, and employing quadratic pseudo-Boolean optimization to manage non-submodular energy functions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If discrete optimization with fine distribution of deformation labels is used to handle discontinuities, then accuracy in recovering discontinuous deformations is improved, but the number of labels increases dramatically making the problem computationally intractable

Engineering Contradiction:
Improveaccuracy in recovering discontinuous deformationsVSAvoidnumber of discrete deformation labels
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the deformation field into discrete labels representing different deformation states. By formulating the problem as a discrete optimization task where each voxel is assigned one of a finite set of labels, the method can capture discontinuities while avoiding the combinatorial explosion of fully continuous approaches. The segmentation is achieved through defining a label set that includes both smooth deformation labels and discontinuity labels.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter representation from continuous deformation vectors to discrete labels. This parameter transformation allows the use of discrete optimization techniques that can efficiently handle the labeling problem. The energy function is designed to work with these discrete parameters, using regularization terms that encourage smoothness while allowing discontinuities where the data strongly indicates them.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If continuous deformation methods are used to maintain smoothness, then computational efficiency is improved, but accuracy in handling discontinuous deformations deteriorates

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidaccuracy in handling discontinuous deformations
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent substitutes the continuous mechanical deformation model with a discrete labeling model. Instead of solving differential equations or using iterative optimization on continuous fields, the method uses discrete optimization with an energy function that can be minimized using graph-cut or dynamic programming algorithms. This substitution maintains computational efficiency while enabling accurate capture of discontinuities through the discrete label structure.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces dynamics by allowing the deformation model to adapt locally - being smooth in some regions and discontinuous in others. The energy function includes data fidelity terms that drive the solution toward discontinuities where the image data indicates sharp changes, while regularization terms maintain smoothness elsewhere. This dynamic adaptation allows the model to automatically adjust its behavior based on local image characteristics.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If subpixel accurate deformation vectors are used for large deformations, then registration accuracy is improved, but the size of the label set increases making optimization difficult

Engineering Contradiction:
Improveregistration accuracyVSAvoidsize of label set
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent adds a discrete label dimension to the deformation representation. Instead of solely relying on continuous deformation vectors with subpixel accuracy, the method introduces a discrete label dimension that can represent different deformation regimes. This additional dimension allows the model to capture large deformations and discontinuities without requiring an exponentially fine continuous grid, thus avoiding the combinatorial explosion of the label set size.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS9449384B2Method for registering deformable images using random Markov fields
Publication Date: 2016.09.20 MITSUBISHI ELECTRIC RESEARCH LABORATORIES INC
  • US9449384B2 patent drawing
  • US9449384B2 patent drawing
  • US9449384B2 patent drawing

AI summary

A method registers a source image with a target image, wherein the images are deformable, by first measuring dissimilarity between the source image and the target image. The dissimilarity minimized using a discrete energy function. At multiple scales, multi-scale Markov random field registration is applied to the source and target images to determine a deformation vector field. Then, the target image is warped according to the deformation field vector to obtain a warped target mage registered to the source image.