GAN Medical Image Classification Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Deep learning algorithms for medical image classification face challenges due to the scarcity of labeled medical image datasets, high costs of annotation, and overfitting to specific data domains, limiting their performance when applied to new data sources.

Innovation Solution

A generative adversarial network (GAN) framework is employed to generate realistic medical images, augmenting the training dataset and enabling the classification of medical images into normal and abnormal categories, using both labeled and unlabeled data to reduce the need for extensive annotation and improve domain adaptability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If deep learning algorithms are trained on limited labeled medical image datasets, then training cost and time are reduced, but classification accuracy and reliability deteriorate

Engineering Contradiction:
Improvetraining timeVSAvoidclassification accuracy
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent employs GANs to generate synthetic medical images that copy the statistical properties and visual characteristics of real medical images. The generator creates realistic synthetic images while the discriminator ensures they meet quality standards, enabling training on augmented datasets without additional annotation costs

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs preliminary data augmentation by generating synthetic medical images before the actual classification training. This pre-processing step creates an expanded training dataset that includes both real and synthetic images, preparing the model for more robust training without increasing annotation workload

Inventive Principle:
Principle #10Preliminary action

2Reliability

If medical image datasets are extensively annotated to improve classification accuracy, then model performance improves, but annotation cost and time consumption increase

Engineering Contradiction:
Improveclassification accuracyVSAvoidannotation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The GAN framework generates synthetic medical images that replicate the characteristics of annotated real images. These synthetic images serve as additional training samples without requiring manual annotation, effectively copying useful training patterns from the limited annotated dataset

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transforms the training approach by changing the data parameter from solely real annotated images to a mixture of real and synthetic images. This parameter change in data composition allows the model to learn from diverse samples while maintaining the same annotation effort

Inventive Principle:
Principle #35Parameter changes

3Reliability

If deep learning models are trained on specific data domains to achieve high accuracy, then model performance on that domain improves, but adaptability to new data sources deteriorates

Engineering Contradiction:
Improvemodel performanceVSAvoiddomain adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent creates a multi-functional training framework where the GAN system can adapt to different data domains. The generator and discriminator work together to create domain-specific synthetic images, enabling the classification model to be trained on multiple domains and maintain adaptability across different medical imaging sources

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent performs preliminary domain adaptation by generating synthetic images that bridge the gap between source and target domains. This pre-adaptation step prepares the model for better generalization to new data sources by exposing it to domain variations during training

Inventive Principle:
Principle #10Preliminary action

4Quantity of substance

If Generative Adversarial Networks are used to generate synthetic medical images, then data augmentation capability improves, but system complexity increases

Engineering Contradiction:
Improvetraining dataset sizeVSAvoidsystem complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent segments the complex GAN system into distinct functional modules: the generator network, the discriminator network, and the training loop. This segmentation allows each component to be developed, trained, and optimized independently, managing the overall system complexity

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10540578B2Adapting a generative adversarial network to new data sources for image classification
Publication Date: 2020.01.21 MERATIVE US LP
  • US10540578B2 patent drawing
  • US10540578B2 patent drawing
  • US10540578B2 patent drawing

AI summary

Mechanisms are provided to implement a generative adversarial network (GAN) that is trained based on labeled image data, unlabeled image data, and generated image data generated by a generator of the GAN. The GAN comprises a loss function that comprises error components for each of the labeled image data, unlabeled image data, and generated image data which is used to train the GAN. A new data source for which the trained GAN is to be adapted is identified and the trained GAN is adapted for the new data source. Image data in the new data source is classified by applying the adapted GAN to the data in the new data source. Adapting the trained GAN includes obtaining a minimized set of labeled images and utilizing the minimized set of images to perform the adapting of the trained GAN.