Dense Image Registration via Markov Random Field Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current medical image registration methods face challenges in deformable registration, particularly in handling non-linear transformations between different modalities, where existing methods are often sub-optimal due to the complexity of dissimilarity measures and computational inefficiencies, especially when dealing with large deformations and uncertainties.

Innovation Solution

The approach reformulates registration as a Markov Random Field (MRF) optimization problem, using a discrete labeling framework that captures deformations through a deformation grid with control points, allowing for efficient linear programming and incremental estimation, which accounts for uncertainties and smoothness, enabling the use of any dissimilarity measure without gradient computation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If gradient-based optimization techniques are used to minimize dissimilarity measures in deformable registration, then the optimization can be performed efficiently, but the results are often sub-optimal due to the non-convexity of cost functions and sensitivity to initial conditions

Engineering Contradiction:
Improveoptimization efficiencyVSAvoidregistration accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent replaces gradient-based continuous optimization with a discrete graph-cut optimization approach. Instead of using gradient descent on continuous deformation parameters, the method formulates registration as a discrete energy minimization problem on a graph structure, where the optimal deformation is found through combinatorial optimization rather than iterative gradient-based search. This substitution eliminates sensitivity to initial conditions and guarantees convergence to the global optimum.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If dense deformation fields with many control points are used to capture local transformations accurately, then registration precision is improved, but computational complexity increases significantly

Engineering Contradiction:
Improvelocal transformation accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the continuous deformation field into discrete deformation elements associated with graph nodes. Each node represents a local transformation unit, and the overall deformation is composed of these discrete elements. This segmentation allows the use of efficient graph-cut algorithms that scale better than continuous optimization methods, achieving accurate dense registration with reduced computational burden.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If complex dissimilarity measures are used to handle non-linear relationships between different modalities, then registration accuracy is improved, but the optimization becomes more difficult and computationally intensive

Engineering Contradiction:
Improvemulti-modal registration accuracyVSAvoidoptimization difficulty
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent changes the parameter space from continuous deformation parameters to discrete label assignments on graph nodes. By transforming the optimization variables from continuous to discrete, the method can use efficient graph-cut algorithms that handle complex dissimilarity measures without suffering from the non-convexity and local minima problems that plague gradient-based continuous optimization.

Inventive Principle:
Principle #35Parameter changes

4Stability of the object's composition

If continuous deformation models are used to represent smooth transformations, then registration smoothness is improved, but the optimization problem becomes ill-posed and computationally intractable

Engineering Contradiction:
Improvedeformation smoothnessVSAvoidoptimization tractability
Core Design Contradiction:
Stability of the object's compositionVSDevice complexity

Solution Approach 1:

The patent introduces a graph structure as an intermediary between the continuous image data and the discrete optimization process. The graph nodes and edges encode spatial relationships and smoothness constraints, allowing continuous deformation smoothness to be enforced through discrete graph operations. This intermediary structure makes the optimization tractable while preserving the desirable smoothness properties of continuous deformations.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8126291B2System and method for dense image registration using Markov Random Fields and efficient linear programming
Publication Date: 2012.02.28 ECOLE CENTE DE PARIS
  • US8126291B2 patent drawing
  • US8126291B2 patent drawing
  • US8126291B2 patent drawing

AI summary

A method for registering digitized images using Markov Random Fields (MRFs) includes providing a source image f and a target image g, defining a deformation grid of control points, defining a coordinate transformation asT⁡(x)=x+∑p∈G⁢η⁡(x-p)⁢dup,where x is a point on the source image, p is a position vector of control point p, dp is a displacement vector for each control point, up is a label for point p associated with displacement dp, and η( ) is a weighting function for the displacement vector, defining an MRF energy functional to be minimized by T asEt=1G⁢∑p∈G⁢Vpt⁡(up)+1E⁢∑p,q∈E⁢Vpq⁡(up,uq),wherein |G| is a number of control points, |E| is a number of pairs of neighboring control points on a neighborhood system, t is an iteration counter, and associating the MRF with a primary linear program and solving the primary linear program using a fast primal-dual algorithm to yield a coordinate transformation that minimizes the energy functional.