Multi-Model Medical Image Segmentation with Fusion Algorithm

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current automatic segmentation methods for medical images, particularly in radiotherapy planning, face challenges in accurately delineating multiple anatomical structures due to limited resolution and lack of contrast between closely attached structures, leading to inconsistencies and inefficiencies.

Innovation Solution

A platform with a graphical user interface (GUI) decision-making tool allows users to access a database of different segmentation models, select appropriate models for each anatomical structure, and combine the results to achieve accurate multi-structure segmentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual contouring is used to delineate anatomical structures, then segmentation accuracy can be maintained through expert judgment, but the process becomes time-consuming and introduces inter-observer variability

Engineering Contradiction:
Improvesegmentation accuracyVSAvoidcontouring time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system segments the anatomical structure delineation task into multiple independent contouring passes, each focusing on specific structures or regions. This allows parallel processing by multiple observers while maintaining quality control through the fusion algorithm that reconciles different interpretations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The contouring system serves multiple functions simultaneously: it performs initial automated segmentation, enables manual refinement by experts, facilitates inter-observer comparison, and generates fused consensus contours. This multi-functionality resolves the time-accuracy tradeoff by combining automated efficiency with expert precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If multiple segmentation models are applied to contour anatomical structures, then segmentation accuracy improves through model diversity, but system complexity increases

Engineering Contradiction:
Improvesegmentation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges multiple segmentation models into a unified multi-model system that processes the same medical images through different algorithms. The fusion algorithm combines outputs from various models, leveraging their diverse strengths to improve overall segmentation accuracy while presenting a single integrated interface to users.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The fusion algorithm acts as an intermediary between multiple segmentation models and the final contour output. It reconciles conflicting segmentations, resolves ambiguities, and produces consensus contours, thereby managing the complexity of coordinating multiple models while maximizing their collective accuracy benefits.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If deep learning models are trained on specific datasets to segment anatomical structures, then segmentation performance improves for those structures, but the models fail to properly contour structures outside their training distribution

Engineering Contradiction:
Improvesegmentation performanceVSAvoidstructure coverage
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The segmentation system achieves universality by integrating multiple deep learning models, each trained on different datasets and specialized for different anatomical structures. This ensemble approach allows the system to handle a broader range of structures than any single model, while maintaining high performance for each specific structure through its specialized model.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system dynamically changes model parameters by selecting and weighting different segmentation models based on the specific anatomical structure being analyzed. For each structure, the fusion algorithm adjusts the contribution of different models according to their training expertise, thereby optimizing performance while adapting to diverse anatomical variations.

Inventive Principle:
Principle #35Parameter changes

4Productivity

If atlas-based segmentation methods are used to extrapolate anatomical structures to new patients, then segmentation speed improves, but accuracy decreases due to sensitivity to atlas selection and registration accuracy

Engineering Contradiction:
Improvesegmentation speedVSAvoidsegmentation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary actions by pre-processing medical images with multiple segmentation models before final contour generation. This includes automated preprocessing steps that prepare images for optimal processing, enabling faster subsequent contouring while maintaining accuracy through the preliminary multi-model analysis.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The fusion algorithm incorporates feedback mechanisms that evaluate the quality of atlas-based segmentations and adjust the registration and selection processes accordingly. By feeding back information about segmentation quality to the atlas selection and registration steps, the system improves accuracy while maintaining the speed benefits of atlas-based methods.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12223660B2Systems and methods for automatic segmentation in medical imaging with multiple anatomical structure segmentation models
Publication Date: 2025.02.11 SIEMENS HEALTHINEERS INTERNATIONAL AG
  • US12223660B2 patent drawing
  • US12223660B2 patent drawing
  • US12223660B2 patent drawing

AI summary

Systems and methods for anatomical structure segmentation in medical images using multiple anatomical structures, instructions and segmentation models.