Nuclei Area Number Estimation IHC Image Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for nuclei area and number estimation in Immunohistochemistry (IHC) images are fast but lack accuracy, particularly in cases where nuclei are connected or vary significantly in shape and intensity, leading to under-estimation and over-estimation challenges.

Innovation Solution

A two-stage estimation framework is employed, starting with nuclei area estimation using stain separation and adaptive thresholding, followed by nuclei number estimation through local shape feature extraction and voting rules to determine the number of nuclei, with user-selected regions for training and Gaussian Mixture Model (GMM) clustering to enhance image quality and filter artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If automated nuclei area estimation algorithms are used for fast processing, then processing speed is improved, but nuclei number estimation accuracy deteriorates due to under-estimation and over-estimation issues

Engineering Contradiction:
Improveprocessing speedVSAvoidnuclei number estimation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent divides the image processing into two independent stages: nuclei area estimation (fast processing) and nuclei number estimation (accurate counting). By segmenting the overall task into separate modules with different optimization goals, the system achieves both speed and accuracy - the area estimation provides rapid initial processing while the subsequent number estimation using local voting rules corrects counting errors without reprocessing the entire image at high computational cost.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary representation - the nuclei area estimation results and extracted shape features - that serves as input for the number estimation stage. This intermediary data structure allows the system to leverage fast area-based processing while providing sufficient information for accurate number counting, acting as a bridge between speed-optimized and accuracy-optimized processing stages.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If manual user interaction is required for specifying cut-off threshold values, then measurement precision is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvethreshold accuracyVSAvoiduser interaction requirement
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system performs self-service by automatically determining optimal threshold values through the local voting rule mechanism. Instead of requiring users to manually specify cut-off values, the algorithm autonomously identifies nuclei centers through voting and derives thresholds from the distribution of voting scores, eliminating the need for manual threshold specification while maintaining accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent transforms the fixed manual threshold parameter into a dynamic parameter determined by the data distribution. The cut-off threshold is no longer a static user-input value but is automatically adjusted based on the voting score distribution and local shape features, allowing the system to adapt to different images and staining conditions without user intervention.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If existing nuclei area estimation methods are used, then processing speed is improved, but reliability deteriorates due to inability to provide nuclei number estimation

Engineering Contradiction:
Improveprocessing speedVSAvoidcompleteness of analysis
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent creates a multi-functional system where the processing pipeline serves dual purposes: generating nuclei area measurements and determining nuclei counts. By designing the number estimation module to utilize the same processing stages and intermediate results as area estimation, the system achieves both functions simultaneously without requiring separate processing chains, thus maintaining speed while adding reliability through comprehensive analysis.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10430943B2Automated nuclei area/number estimation for IHC image analysis
Publication Date: 2019.10.01 SONY GROUP CORP
  • US10430943B2 patent drawing
  • US10430943B2 patent drawing

AI summary

Automated nuclei area/number estimation utilizes a two-stage estimation framework-area estimation first followed by number estimation. After determining area information, each local patch's shape features are able to be extracted to define a local voting rule. The resulting voting score determines the strength of each local voting peak. The number of voting peaks is exactly the number of nuclei.