Mitral Leaflet Segmentation via Multi-Atlas Fusion and Deformable Modeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D transesophageal echocardiography (TEE) image analysis tools are impractical and inadequate for quantitative image-based surgical planning due to limited user interaction and inability to capture patient-specific detail of mitral leaflet geometry, especially in complex morphological abnormalities like ischemic mitral regurgitation.

Innovation Solution

A fully automated method integrating probabilistic segmentation and geometric modeling techniques, specifically multi-atlas joint label fusion and deformable modeling with continuous medial representation (cm-rep), to segment mitral leaflets in 3D TEE images without user interaction, capturing patient-specific detail and representing leaflets with locally varying thickness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If fully automated segmentation method is implemented, then productivity and ease of operation are improved, but device complexity increases

Engineering Contradiction:
Improvesegmentation efficiencyVSAvoidalgorithm complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The method segments the mitral valve into distinct anatomical components (annulus, anterior leaflet, posterior leaflet) using separate probabilistic atlases for each structure. This segmentation approach allows the complex segmentation task to be broken down into manageable components, improving automation while maintaining clinical accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Probabilistic atlases are pre-computed from manual expert segmentations before the automated process. These pre-computed probability maps serve as templates that guide the automated segmentation, eliminating the need for real-time complex calculations during actual use and improving processing speed

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multi-atlas joint label fusion is used, then measurement precision is improved, but computational resources and time increase

Engineering Contradiction:
Improvesegmentation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Multiple probabilistic atlases (from different reference images) are merged using joint label fusion to create a consensus segmentation. This combining approach leverages information from multiple sources to improve accuracy while the probabilistic framework efficiently integrates the multiple inputs without requiring exhaustive computation

Inventive Principle:
Principle #5Merging (Combining)

3Manufacturing precision

If continuous medial representation with variable thickness is implemented, then manufacturing precision and measurement precision are improved, but device complexity increases

Engineering Contradiction:
Improvegeometric modeling accuracyVSAvoidmodel complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The continuous medial representation model assigns locally varying thickness values at different positions along the mitral valve structure. This local quality approach allows the model to capture patient-specific geometric details (such as varying leaflet thickness) without requiring a completely complex custom model for each case, as the variability is handled systematically through the field-based representation

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9406142B2Fully automatic image segmentation of heart valves using multi-atlas label fusion and deformable medial modeling
Publication Date: 2016.08.02 THE TRUSTEES OF THE UNIV OF PENNSYLVANIA
  • US9406142B2 patent drawing
  • US9406142B2 patent drawing
  • US9406142B2 patent drawing

AI summary

A fully automatic method for segmentation of the mitral leaflets in 3D transesophageal echocardiographic (3D TEE) images is provided. The method combines complementary probabilistic segmentation and geometric modeling techniques to generate 3D patient-specific reconstructions of the mitral leaflets and annulus from 3D TEE image data with no user interaction. In the model-based segmentation framework, mitral leaflet geometry is described with 3D continuous medial representation (cm-rep). To capture leaflet geometry in a target 3D TEE image, a pre-defined cm-rep template of the mitral leaflets is deformed such that the negative log of a Bayesian posterior probability is minimized. The likelihood of the objective function is given by a probabilistic segmentation of the mitral leaflets generated by multi-atlas joint label fusion, while the validity constraints and regularization terms imposed by cm-rep act as shape priors that preserve leaflet topology and constrain model fitting.