Medical Image Segmentation Using Geodesic Distance Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current medical image segmentation methods face challenges in achieving accurate and robust results due to poor image quality, variations among patients, and the need for extensive user interactions, especially when dealing with complex anatomical structures and low-contrast images.

Innovation Solution

A deep learning-based system that integrates user interactions through geodesic distance maps with convolutional neural networks (CNNs) to refine initial segmentations, allowing for efficient and accurate segmentation of medical images with minimal user input, while preserving image resolution and enabling adaptation to different imaging modalities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional CNNs with pooling and down-sampling are used for segmentation, then computational efficiency is improved, but output resolution is reduced leading to blob-like results and low accuracy for small structures

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidsegmentation accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent segments the CNN architecture into encoder and decoder pathways, where the encoder performs down-sampling for feature extraction and the decoder performs up-sampling for resolution recovery. This segmentation allows each part to specialize: the encoder focuses on computational efficiency while the decoder restores segmentation accuracy through transposed convolutions and skip connections.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements nested feature pyramids where features at different scales are hierarchically organized and integrated. The encoder generates features at multiple down-sampled levels, and the decoder nestles these features back together through up-sampling, creating a nested structure that preserves both coarse contextual information and fine spatial details for accurate segmentation.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Manufacturing precision

If dilated convolution is used to expand receptive field without loss of resolution, then segmentation accuracy is improved, but device complexity increases due to additional layers

Engineering Contradiction:
Improvesegmentation accuracyVSAvoidnetwork complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent dynamically adjusts the receptive field through the hierarchical encoder-decoder structure. Instead of using fixed dilated convolution layers, the network dynamically expands its receptive field by progressively down-sampling in the encoder and then recovering resolution in the decoder, allowing flexible adaptation to different scale requirements without increasing structural complexity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent transitions from the spatial dimension to the feature dimension by using channel concatenation and fusion operations. Instead of expanding spatially through dilated convolutions, the network enriches features by combining information from multiple encoder levels at different scales, achieving comprehensive receptive field coverage through feature space integration rather than spatial expansion.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Manufacturing precision

If CRF with Gaussian pairwise potentials is used for spatial regularization, then edge details are recovered, but parameter tuning becomes time-consuming and may not ensure optimal values

Engineering Contradiction:
Improveedge detail recoveryVSAvoidparameter tuning time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements self-service by training the CNN to automatically learn spatial regularization patterns during the main segmentation training process. The network learns to preserve edges and spatial structures through the encoder-decoder architecture and skip connections, eliminating the need for separate CRF parameter tuning. The system serves its own spatial regularization needs through learned features rather than manual parameter adjustment.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical CRF system with Gaussian potentials and manual parameter tuning with a learned neural network system. Instead of using fixed mathematical models requiring parameter adjustment, the network learns spatial relationships and edge preservation directly from data through back-propagation, substituting the mechanical optimization process with adaptive learning.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Extent of automation

If fully connected CRF is formulated as RNN for end-to-end training, then automatic learning is enabled, but the Gaussian constraint becomes too restrictive for complex cases

Engineering Contradiction:
Improveautomatic learning capabilityVSAvoidflexibility for complex cases
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The patent creates a dynamic architecture where the encoder-decoder pathways can adaptively adjust feature extraction and reconstruction based on input complexity. The network dynamically routes information through skip connections at different levels, allowing flexible handling of complex cases without being constrained by fixed Gaussian potentials. This dynamic structure provides the adaptability needed for diverse medical imaging scenarios.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the fundamental parameters of the model from fixed Gaussian potential functions to learnable convolutional filters and feature transformations. Instead of being constrained by the mathematical form of Gaussian potentials, the network learns appropriate spatial relationships through trainable parameters, enabling adaptation to complex cases while maintaining end-to-end automatic learning through gradient-based optimization.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11379985B2System and computer-implemented method for segmenting an image
Publication Date: 2022.07.05 KINGS COLLEGE LONDON
  • US11379985B2 patent drawing
  • US11379985B2 patent drawing
  • US11379985B2 patent drawing

AI summary

A computer-implemented method for segmenting an input image, the method comprises: generating a first segmentation of the input image using a first machine learning system, the first segmentation comprising multiple segments; receiving, from a user, at least one indication, wherein each indication corresponds to a particular segment from the multiple segments, and indicates one or more locations of the input image as belonging to that particular segment; constructing, for each segment of the multiple segments having at least one corresponding indication, a respective geodesic distance map, based on the input image and the user indications received for that segment; and generating a second segmentation using a second machine learning system based on the input image and the constructed geodesic distance maps.