Sensor Data Classification With Dirichlet Uncertainty Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional multi-class classifiers for sensor data in computer-controlled systems fail to provide calibrated in-domain uncertainties, leading to potential misclassification and unsafe automated decisions, especially when encountering out-of-distribution data or edge cases.

Innovation Solution

A classification model that combines a trained inference model with a generative model to determine concentration parameters of a Dirichlet distribution, using these parameters for both out-of-distribution detection and class probability calculation, allowing for better calibration of uncertainty values.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a conventional multi-class classifier is used to determine out-of-distribution data, then out-of-distribution detection capability is provided, but calibrated in-domain uncertainty is not available

Engineering Contradiction:
Improveout-of-distribution detectionVSAvoidin-domain uncertainty calibration
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent combines a multi-class classifier with a generative model into a unified system. The classifier processes sensor data to identify classes, while the generative model simultaneously evaluates the likelihood of the data under each class. This merging allows the system to provide both out-of-distribution detection (via the classifier) and calibrated in-domain uncertainty (via the generative model's likelihood estimates), resolving the contradiction between these two capabilities.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The generative model acts as an intermediary between the sensor data and the final classification output. It receives the sensor data and class labels from the classifier, then computes calibrated uncertainty measures by evaluating how well the data fits each class distribution. This intermediary component enables the system to provide reliable uncertainty calibration without compromising out-of-distribution detection capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If sensor data is classified using a trained model, then classification speed is improved, but misclassification occurs on edge cases and out-of-distribution data

Engineering Contradiction:
Improveclassification speedVSAvoidclassification accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system implements feedback by using the generative model to evaluate the confidence of each classification. When the generative model detects low likelihood or high uncertainty (indicating potential misclassification on edge cases or out-of-distribution data), it provides feedback that triggers further processing or alternative classification strategies. This feedback mechanism maintains high classification speed for confident predictions while improving reliability for uncertain cases.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system applies partial action by selectively invoking additional processing only when needed. For clear, in-distribution cases, the system quickly outputs classification results without additional computation. For edge cases or out-of-distribution data detected by the generative model, the system performs additional validation or alternative classification. This approach maintains high overall productivity while improving reliability for problematic cases.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240071048A1Safe control/monitoring of a computer-controlled system
Publication Date: 2024.02.29 ROBERT BOSCH GMBH
  • US20240071048A1 patent drawing
  • US20240071048A1 patent drawing
  • US20240071048A1 patent drawing

AI summary

A computer-implemented method of classifying sensor data for use in controlling and/or monitoring a computer-controlled system. The classification model includes an inference model that, based on the sensor data, determines respective concentration parameters of a Dirichlet distribution of class probabilities for the respective multiple classes. The classification model further includes a generative model that, based on the class probabilities, determines parameters of a probability distribution of sensor data according to a training dataset of the classification model. Concentration parameters according to the inference model are used for anomaly detection by determining a probability of the sensor data being generated according to the generative model based on the concentration parameters. The same concentration parameters are used to determine class probabilities.