Joint Deep Learning Model Triad Predictors Medical Image Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional image segmentation methods for medical images face challenges such as noise, varying contrast, complex shapes, and the need for significant training data, particularly in learning foreground, background, and shape interactions, which can lead to interpretability issues and overfitting.

Innovation Solution

A system and method using a joint deep learning model with a triad of predictors to jointly learn foreground, background, and shape models, leveraging generative modeling and fully convolutional networks (FCNs) to capture contextual information, even with limited training data, and incorporating shape regularization to improve segmentation accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If fully convolutional networks (FCNs) are used to learn foreground, background, and shape interactions, then segmentation accuracy is improved, but the amount of training data required increases significantly

Engineering Contradiction:
Improvesegmentation accuracyVSAvoidtraining data volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The model segments the segmentation task into three distinct predictors: foreground predictor, background predictor, and shape predictor. Each predictor learns specific aspects of the segmentation problem independently, reducing the overall data requirement compared to learning all interactions simultaneously in a single FCN framework.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The joint deep learning model serves multiple functions simultaneously: it performs foreground segmentation, background segmentation, and shape boundary detection through its triad of predictors. This multi-functionality allows the system to achieve comprehensive segmentation accuracy without requiring separate models for each function, thereby reducing total training data needs.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If traditional segmentation approaches with geometric priors and intensity models are used, then interpretability is maintained, but computational timing and hyperparameter tuning become problematic

Engineering Contradiction:
ImproveinterpretabilityVSAvoidcomputational timing
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces traditional mechanical segmentation approaches (geometric priors, intensity models, manual initialization) with a deep learning-based joint model. This substitution maintains interpretability through the modular triad structure while eliminating the need for manual hyperparameter tuning and initialization, significantly reducing computational timing and operational complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If manual selection of training data is performed to improve FCN performance, then segmentation accuracy increases, but the process becomes problematic and time-consuming

Engineering Contradiction:
Improvesegmentation accuracyVSAvoiddata selection complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The joint deep learning model with its triad of predictors is designed to be self-sufficient in learning foreground, background, and shape representations simultaneously. The model automatically adapts to the available data without requiring manual selection or curation processes, eliminating the complexity and time associated with manual data selection while maintaining segmentation accuracy.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11810301B2System and method for image segmentation using a joint deep learning model
Publication Date: 2023.11.07 GENERAL ELECTRIC CO
  • US11810301B2 patent drawing
  • US11810301B2 patent drawing
  • US11810301B2 patent drawing

AI summary

A method for image segmentation includes receiving an input image. The method further includes obtaining a deep learning model having a triad of predictors. Furthermore, the method includes processing the input image by a shape model in the triad of predictors to generate a segmented shape image. Moreover, the method includes presenting the segmented shape image via a display unit.