Multi-Channel CNN for Breast MRI Malignancy Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Automated analysis of large sequences of breast MRI images is challenging due to the large number of images and the lack of publicly available labeled datasets, making it difficult for human radiologists to accurately identify malignant lesions, and existing automated methods struggle with small training datasets and the difference between medical and natural images.

Innovation Solution

A method using a deep convolutional neural network (CNN) that analyzes a multi-channel image representation created from baseline, peak contrast, and delayed response images, trained on a small dataset to classify the likelihood of malignancy, which includes intensity, contrast-update, and contrast-washout channels, and optionally incorporates patch distinctiveness and cross-saliency maps to enhance detection accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual interpretation of breast MRI images is performed by radiologists, then diagnostic accuracy can be maintained, but processing time and workload increase significantly

Engineering Contradiction:
Improvediagnostic accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

A deep convolutional neural network (CNN) is introduced as an intermediary system that automatically analyzes breast MRI images to detect malignancy indicators. The CNN processes the images and provides diagnostic assistance, reducing the time burden on radiologists while maintaining diagnostic accuracy through automated feature extraction and classification

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service by allowing the CNN to autonomously perform image analysis without requiring manual intervention for each image. The automated detection system processes MRI sequences independently, identifying suspicious lesions and generating diagnostic recommendations that reduce radiologist workload

Inventive Principle:
Principle #25Self-service

2Productivity

If existing automated methods are used for breast MRI analysis, then processing efficiency improves, but accuracy deteriorates due to small training datasets and differences between medical and natural images

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddetection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system transforms medical images into a multi-channel representation that captures temporal contrast enhancement patterns. By converting the temporal sequence into three distinct channels (intensity, contrast-update, contrast-washout), the system adapts the input parameters to better suit the CNN's processing capabilities while preserving critical diagnostic information

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent adds a temporal dimension to the image analysis by creating a multi-channel representation from sequential MRI images. This transformation converts time-series data into a spatial-like structure that CNNs can process effectively, bridging the gap between medical imaging data and natural image processing capabilities

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If large sequences of breast MRI images are analyzed, then detection completeness improves, but processing complexity and storage requirements increase

Engineering Contradiction:
Improvedetection completenessVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system extracts only the essential temporal information from the complete MRI sequence by identifying key frames (pre-contrast, peak contrast, delayed response) and converting them into a compact multi-channel representation. This extraction process retains detection completeness while significantly reducing the data volume and processing complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The MRI sequence is segmented into three critical phases (pre-contrast, peak contrast, delayed response) that are then processed independently and combined into a multi-channel representation. This segmentation approach maintains comprehensive analysis while organizing the data in a more manageable structure for the CNN

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10580137B2Systems and methods for detecting an indication of malignancy in a sequence of anatomical images
Publication Date: 2020.03.03 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10580137B2 patent drawing
  • US10580137B2 patent drawing
  • US10580137B2 patent drawing

AI summary

A method for detecting an indication of likelihood of malignancy, comprising: receiving a sequence of anatomical images of a breast of a target individual acquired over a time interval during which contrast is administered, analyzing the sequence of anatomical images to identify: a baseline pre-contrast image denoting lack of contrast, a peak contrast image denoting a peak contrast enhancement, an initial uptake image denoting initial contrast enhancement, and a delayed response image denoting final contrast enhancement, creating a multi-channel image representation comprising: intensity channel including the peak contrast enhanced image, contrast-update channel including the computed difference between the peak contrast enhanced image and the pre-contrast image, and contrast-washout channel including the computed difference between the initial uptake image and the delayed response image, and computing by a trained deep convolutional neural network, a classification category indicative of likelihood of malignancy for the sequence according to the multi-channel image representation.