Multi-label Medical Image Classification via Curriculum Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current medical image classification methods require extensive manual labeling and are prone to data defects, such as missing or misinterpreted labels, which hinder efficient detection of abnormal conditions in medical images.

Innovation Solution

A multi-label classification method that involves training a first model with an initial dataset, estimating image difficulty levels, and dividing the dataset into subsets for curriculum learning, allowing a second model to generate comprehensive labels for abnormal features through a series of training rounds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual labeling is used for medical images, then labeling accuracy can be ensured, but time consumption and cost increase significantly

Engineering Contradiction:
Improvelabeling accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically generating initial labels using a pre-trained classification model before manual review. This preliminary labeling reduces the time required for manual annotation while maintaining acceptable accuracy through subsequent correction steps.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A semi-automated classification model acts as an intermediary between complete manual labeling and fully automated labeling. The model generates initial labels that are then refined by medical personnel, reducing their workload while maintaining high accuracy through the collaborative process.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If complete labeling of all abnormal features is performed, then diagnostic accuracy improves, but data defects such as missing or misinterpreted labels increase

Engineering Contradiction:
Improvediagnostic accuracyVSAvoiddata quality
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system implements a feedback mechanism where the classification model is continuously retrained using corrected labels from medical personnel. This feedback loop improves the model's accuracy over time while reducing data defects, as the model learns from corrections and generates more reliable labels in subsequent iterations.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary classification to identify potential abnormal features before detailed labeling. This preliminary action helps focus manual labeling efforts on uncertain cases, reducing the overall number of labels that require manual verification and minimizing data defects.

Inventive Principle:
Principle #10Preliminary action

3Ease of manufacture

If a single classification model is trained with all data, then training simplicity is maintained, but training efficiency and model performance on difficult cases decrease

Engineering Contradiction:
Improvetraining simplicityVSAvoidtraining efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The training dataset is segmented into multiple subsets based on difficulty levels (easy, medium, hard cases). The model is trained sequentially on these subsets, starting with easier cases and progressively tackling more difficult ones. This segmentation improves training efficiency by allowing the model to build foundational knowledge before handling complex cases, while maintaining reasonable simplicity through automated difficulty assessment.

Inventive Principle:
Principle #1Segmentation

4Loss of information

If extensive manual labeling is performed to ensure comprehensive coverage, then label completeness improves, but resource consumption and cost increase

Engineering Contradiction:
Improvelabel completenessVSAvoidresource consumption
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The classification model serves as an intermediary that generates initial labels for all images, including those that would otherwise require manual labeling. This reduces the quantity of manual labeling resources needed while maintaining label completeness, as the model can process unlimited images without additional human resources.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service labeling where the classification model automatically generates labels for images without requiring manual intervention for every case. Medical personnel only need to review and correct uncertain cases, allowing the system to scale to large datasets without proportional increases in human resources.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240161293A1Multi-label classification method for medical image
Publication Date: 2024.05.16 HTC CORP
  • US20240161293A1 patent drawing
  • US20240161293A1 patent drawing
  • US20240161293A1 patent drawing

AI summary

A multi-label classification method for generating labels annotated on medical images. An initial dataset including medical images and partial input labels is obtained. The partial input labels annotate a labeled part of abnormal features on the medical images. A first multi-label classification model is trained with the initial dataset. Difficulty levels of the medical images in the initial dataset are estimated based on predictions generated by the first multi-label classification model. The initial dataset is divided based on the difficulty levels of the medical images into different subsets. A second multi-label classification model is trained based on subsets with gradually increasing difficulty levels during different curriculum learning rounds. Predicted labels annotated on the medical images are generated about each of the abnormal features based on the second multi-label classification model.