Probability Distribution Visualization for Neural Network Interpretability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for cell classification using artificial neural networks struggle to provide interpretable classification performance, as the meaning of classification conditions within the networks is not readily understandable by humans, making it difficult to evaluate the performance effectively.

Innovation Solution

A display control device and method that obtain and display the probability distribution of classification results using a graph with a probability axis, allowing humans to interpret the classification performance of artificial neural networks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If artificial neural networks are used for cell classification, then classification performance is improved, but interpretability of classification conditions deteriorates

Engineering Contradiction:
Improveclassification performanceVSAvoidinterpretability of classification conditions
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent introduces a probability distribution visualization as an intermediary between the neural network's internal classification conditions and human understanding. By displaying the probability distribution of classification results, the system mediates the information loss, allowing humans to interpret the neural network's decision-making process without exposing the complex internal weights and conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If classification conditions of artificial neural networks are made more interpretable, then ease of operation is improved, but classification performance may deteriorate

Engineering Contradiction:
Improveease of evaluating classification performanceVSAvoidcomplexity of neural network structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the probability distribution information from the neural network's internal processing and presents it separately as a visualization. This extraction allows users to evaluate classification performance without needing to understand the complex internal structure of the neural network, thereby improving ease of operation while maintaining the network's complexity for optimal performance.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12136148B2Method, system, device, and program for displaying probabilistic classification results
Publication Date: 2024.11.05 K K CYBO
  • US12136148B2 patent drawing
  • US12136148B2 patent drawing
  • US12136148B2 patent drawing

AI summary

A display method, system, device, and related computer programs can present the classification performance of an artificial neural network in a form interpretable by humans. In these methods, systems, devices, and programs, a probability calculator (i.e., a classifier) based on an artificial neural network calculates a classification result for an input image in the form of a probability. The distribution of classification-result probabilities are displayed using at least one display axis of a graph as a probability axis.