Rule Extraction for Interpretable Medical Image Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer-aided diagnosis (CAD) systems for medical images, particularly those using 'black-box' classifiers like Support Vector Machines, are difficult for humans to interpret, which hinders their acceptance in clinical practice and increases regulatory barriers due to the lack of explainability.

Innovation Solution

The method converts linear support vector machines and other hyperplane-based classifiers into sets of non-overlapping, easily interpretable rules that cover most training examples, using optimization problems to maximize volume or number of samples covered, allowing for human-understandable explanations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If black-box classifiers like Support Vector Machines are used for medical image classification, then generalization performance is improved, but interpretability deteriorates

Engineering Contradiction:
Improvegeneralization performanceVSAvoidinterpretability
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces rule extraction as an intermediary process that translates the decisions of black-box classifiers into human-interpretable rules. The system extracts if-then rules from the classifier's decision boundaries, creating a mediator layer that preserves the high generalization performance of SVMs while providing the interpretability needed for clinical acceptance and regulatory approval.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent extracts the essential decision-making logic from the black-box classifier by identifying and formulating explicit classification rules. This extraction process separates the interpretability function from the classification function, allowing the system to maintain accurate classification performance while providing transparent, explainable rules that physicians can understand and trust.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If black-box classifiers are used in medical diagnosis systems, then diagnostic accuracy is improved, but regulatory approval becomes more difficult

Engineering Contradiction:
Improvediagnostic accuracyVSAvoidregulatory complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The rule extraction system serves as a mediator between the high-accuracy black-box classifier and regulatory requirements. By translating classifier decisions into explicit, interpretable rules, the system provides the transparency and explainability that regulatory bodies require for medical device approval, without sacrificing the diagnostic accuracy achieved by sophisticated classifiers.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the output representation of the classifier from opaque probability scores or margin values into explicit logical rules with clear conditions and outcomes. This parameter change in the output format makes the system's decision-making process transparent and auditable, directly addressing regulatory requirements for explainability while preserving diagnostic accuracy.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If hyperplane-based classifiers are used for feature classification, then classification performance is improved, but ease of interpretation deteriorates

Engineering Contradiction:
Improveclassification performanceVSAvoidease of interpretation
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent extracts explicit classification rules from the hyperplane-based classifier's decision boundaries. By identifying the geometric relationships and formulating them as if-then rules, the system separates the high-performance classification function from the interpretation function, allowing physicians to understand the classification logic in terms of simple, intuitive rules rather than complex mathematical hyperplanes.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS7512276B2System and method for feature identification in digital images based on rule extraction
Publication Date: 2009.03.31 SIEMENS MEDICAL SOLUTIONS USA INC
  • US7512276B2 patent drawing
  • US7512276B2 patent drawing
  • US7512276B2 patent drawing

AI summary

A method for classifying features in a digital medical image includes providing a plurality of feature points in an N-dimensional space, wherein each feature point is a member of one of two sets, determining a classifying plane that separates feature points in a first of the two sets from feature points in a second of the two sets, transforming the classifying plane wherein a normal vector to said transformed classifying plane has positive coefficients and a feature domain for one or more feature points of one set is a unit hypercube in a transformed space having n axes, obtaining an upper bound along each of the n-axes of the unit hypercube, inversely transforming said upper bound to obtain a new rule containing one or more feature points of said one set, and removing the feature points contained by said new rule from said one set.