Tissue Classifier Using Multiple-Instance Learning for Biopsy Diagnosis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In digital pathology, machine learning classifiers face challenges in accurately diagnosing cancerous tissues due to the abundance of healthy tissue, which can lead to reduced classification quality, as they randomly select image regions that resemble both cancerous and healthy tissues.

Innovation Solution

The training of a histological tissue classifier is separated into two parts: training a multiple-instance ROI classifier to minimize error over all regions of interest, and then training a tissue classifier based on actual ROI outputs, allowing for the aggregation of noisy decisions and eliminating the need for fine-grain labeling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional machine learning classifiers randomly select image regions for training, then the classification process is simple, but the classification accuracy deteriorates because healthy tissue regions resemble cancerous tissue

Engineering Contradiction:
Improveclassification accuracyVSAvoidtraining process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the tissue image into multiple regions of interest (ROIs) and applies multiple-instance learning where each ROI is an instance within a bag representing the entire tissue. This segmentation allows the system to focus on discriminative regions while maintaining the overall tissue context, resolving the contradiction between accuracy and complexity by structuring the training data to highlight meaningful patterns without requiring complex preprocessing

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary aggregation layer that combines predictions from multiple ROI classifiers to produce the final tissue-level classification. This intermediary mechanism allows the system to leverage simple ROI-level classifiers while achieving high accuracy through their collective decision, effectively mediating between simple local analysis and accurate global classification

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If all tissue in a cancerous sample is assumed to be cancerous, then the labeling process is simplified, but the classification quality deteriorates due to the abundance of healthy tissue regions

Engineering Contradiction:
Improvelabeling easeVSAvoidclassification quality
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent applies partial action by labeling only the entire tissue slide at the bag level rather than requiring fine-grained labeling of every cancerous region within the tissue. This partial labeling approach maintains ease of data preparation while the multiple-instance learning framework automatically identifies which ROIs contribute to the cancerous classification, resolving the contradiction between labeling simplicity and classification quality

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If multiple-instance learning is applied with heuristic ROI selection, then the training becomes more accurate, but the device complexity increases due to additional processing requirements

Engineering Contradiction:
Improvetissue classification accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the large tissue image into smaller, manageable ROIs that can be processed independently by individual classifiers. This segmentation reduces the computational burden on each classifier while maintaining high accuracy through the collective decision of multiple classifiers, effectively managing the trade-off between precision and processing complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system processes only a subset of ROIs that are most relevant to the classification decision, rather than requiring exhaustive analysis of every region. The aggregation mechanism focuses computational resources on discriminative regions while still achieving accurate tissue-level classification, balancing precision requirements with processing complexity

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9060685B2Whole tissue classifier for histology biopsy slides
Publication Date: 2015.06.23 NEC CORP
  • US9060685B2 patent drawing
  • US9060685B2 patent drawing
  • US9060685B2 patent drawing

AI summary

Disclosed is a computer implemented method for fully automated tissue diagnosis that trains a region of interest (ROI) classifier in a supervised manner, wherein labels are given only at a tissue level, the training using a multiple-instance learning variant of backpropagation, and trains a tissue classifier that uses the output of the ROI classifier. For a given tissue, the method finds ROIs, extracts feature vectors in each ROI, applies the ROI classifier to each feature vector thereby obtaining a set of probabilities, provides the probabilities to the tissue classifier and outputs a final diagnosis for the whole tissue.