Automated Prostate Cancer Annotation Using ML and IHC Staining

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current diagnostic tests for prostate cancer, such as digital rectal exams, serum PSA, and TRUS-guided biopsies, lack specificity and accuracy, leading to overtreatment and increased morbidity due to uncertainty in disease assessment, especially for men with low-risk disease.

Innovation Solution

The development of machine learning-based systems that analyze whole-slide images of hematoxylin and eosin (H&E) and immunohistochemical (IHC) stained specimens to automate the annotation of prostate cancer, using a predictive model trained on data from radical prostatectomy specimens, which includes staining with a triple-antibody cocktail of HMWCK, p63, and AMACR, to estimate cancerous epithelium distribution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual annotation of prostatectomy specimens by trained pathologists is used to obtain ground truth data, then accurate cancer detection is achieved, but the process is very time-consuming and laborious

Engineering Contradiction:
Improvecancer detection accuracyVSAvoidannotation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent uses manual pathologist annotations on a subset of specimens to create ground truth labels, then copies this labeling approach to automatically train machine learning models that can annotate all specimens. The trained models replicate the pathologist's detection accuracy without the time cost, enabling scalable annotation while maintaining precision.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical process of manual pathologist annotation with an automated machine learning system. The ML models process whole slide images and IHC images computationally, substituting human manual inspection with algorithmic analysis that achieves comparable accuracy while dramatically reducing time and labor requirements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If current diagnostic tests (DRE, PSA, TRUS-guided biopsy) are used for prostate cancer diagnosis, then screening is possible, but specificity is low leading to overtreatment and increased morbidity

Engineering Contradiction:
Improvescreening capabilityVSAvoiddiagnostic specificity
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent merges multiple data sources including whole slide H&E images, IHC images with triple-antibody cocktails (AMACR, HMWCK, p63), and clinical information into a unified machine learning diagnostic system. This integration of multiple modalities improves diagnostic specificity beyond any single test while maintaining the screening versatility of the workflow.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent changes the diagnostic parameters from traditional clinical measures (PSA levels, biopsy findings) to detailed histopathological image analysis features. By analyzing cellular morphology, staining patterns, and tissue architecture at the microscopic level, the system achieves higher diagnostic specificity while preserving screening capability through automated processing.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If automated machine learning systems are used to analyze whole slide images, then annotation time is reduced and productivity increases, but the complexity of the system increases

Engineering Contradiction:
Improveannotation speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the diagnostic workflow into distinct modular components: whole slide image processing module, IHC image processing module, feature extraction module, and prediction module. Each module handles a specific task independently, which manages system complexity while enabling high-throughput automated annotation and maintaining overall productivity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11631171B2Automated detection and annotation of prostate cancer on histopathology slides
Publication Date: 2023.04.18 REGENTS OF THE UNIVERSITY OF MINNESOTA
  • US11631171B2 patent drawing
  • US11631171B2 patent drawing
  • US11631171B2 patent drawing

AI summary

Automated, machine learning-based systems are described for the analysis and annotation (i.e., detection or delineation) of prostate cancer (PCa) on histologically-stained pathology slides of prostatectomy specimens. A technical framework is described for automating the annotation of predicted PCa that is based on, for example, automated spatial alignment and colorimetric analysis of both H&E and IHC whole-slide images (WSIs). The WSIs may, as one example, be stained with a particular triple-antibody cocktail against high-molecular weight cytokeratin (HMWCK), p63, and α-methylacyl CoA racemase (AMACR).