Outlier Detection Method Using Combined Difference Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing outlier detection methods for measured values in various applications are inefficient in real-time detection and require expert analysis and prior knowledge of data properties, making them time and cost-intensive.
Innovation Solution
A computer-implemented outlier detection method that continuously records data, filters measured values, and determines a combined distribution of differences and noise, allowing for autonomous, real-time outlier identification without requiring expert analysis or prior knowledge.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional outlier detection methods are used, then outlier detection accuracy can be improved, but expert analysis and prior knowledge are required, making the process time and cost intensive
Solution Approach 1:
The system performs self-adjustment by automatically determining optimal parameters through iterative optimization based on synthetic training data, eliminating the need for expert analysis and manual parameter tuning while maintaining high detection accuracy
Solution Approach 2:
The system performs preliminary training with synthetic data before actual outlier detection, pre-determining optimal parameters and creating a ready-to-use detection model that can operate autonomously without requiring expert intervention during real-time detection
2Productivity
If real-time outlier detection is implemented, then productivity is improved, but accurate parameter determination becomes more difficult without prior knowledge of data properties
Solution Approach 1:
The system replaces manual expert analysis with an automated computational approach that uses iterative optimization algorithms to determine parameters, enabling real-time detection while eliminating the difficulty of manual parameter determination
Solution Approach 2:
The system dynamically adjusts detection parameters based on the specific properties of the input data through automated optimization, allowing real-time detection across different applications without requiring pre-knowledge of data characteristics
3Measurement precision
If manual parameter adjustment is performed, then detection accuracy can be improved, but device complexity and expert involvement increase
Solution Approach 1:
The system automatically determines and adjusts its own parameters through iterative optimization algorithms, eliminating the need for manual expert adjustment while maintaining high detection accuracy and reducing operational complexity
Data Source
AI summary
A method of detecting outliers in measured values of a measurand is disclosed, comprising the steps of: based on training data determining a combined distribution of differences between individual measured values and the filtered value of the measured value preceding the respective individual measured value to be expected in the application where the method is applied based on difference distribution of first differences of the filtered values of the measured values and a noise distribution of noise included in the measured values. Next, new measured values are identified as outliers when a probability of occurrence of a difference between the respective new measured value and the filtered value of the preceding measured value according to the combined distribution is lower than a predetermined level of confidence.


