GMRF Anomaly Detection for Industrial Sensor Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current anomaly detection methods in industrial systems, such as those used in offshore oil production, face challenges with noisy sensor data, variable dependencies, and the need for multivariate analysis, particularly in environments with over 100 sensors, where prior methods like k-means and PCA struggle to handle multiple operating modes and provide accurate variable-wise anomaly scoring.

Innovation Solution

A system utilizing Gaussian Markov Random Fields (GMRF) models is developed to detect anomalies by learning weighting factors, mean, and variance from sensor training data, removing unimportant models, and calculating anomaly scores for each variable, allowing for robust anomaly detection in industrial equipment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If prior methods like k-means and PCA are used for anomaly detection, then the system can handle basic sensor data analysis, but they cannot effectively handle multiple operating modes and provide accurate variable-wise anomaly scoring in high-dimensional environments

Engineering Contradiction:
Improvevariable-wise anomaly scoring accuracyVSAvoidhandling multiple operating modes
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent segments the sensor data analysis by creating separate mixture models for different operating modes. Each mixture model is trained on data from a specific operating mode, allowing the system to capture mode-specific patterns and dependencies. This segmentation enables accurate variable-wise anomaly scoring within each mode while adapting to multiple operating modes overall.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transforms the data representation by moving from individual sensor variable analysis to multivariate mixture model analysis. By modeling the joint distribution of multiple variables simultaneously, the system captures complex inter-variable dependencies that univariate methods miss, enabling accurate anomaly detection in high-dimensional spaces with over 100 sensors.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If multivariate analysis is performed on sensor data with over 100 variables, then comprehensive system monitoring is achieved, but the complexity of handling variable dependencies and noise increases significantly

Engineering Contradiction:
Improvesystem monitoring comprehensivenessVSAvoidhandling variable dependencies
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges multiple Gaussian distributions into a mixture model that represents the entire multivariate dataset. By combining several simpler Gaussian components, each capturing local patterns, the mixture model approximates the complex multivariate distribution while maintaining computational tractability. This merging approach handles variable dependencies efficiently without requiring complex computational structures.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent changes the parameter representation by using mixture weights, means, and covariances to describe the multivariate distribution rather than attempting to model all variable interactions directly. This parameter transformation simplifies the complexity of handling dependencies among 100+ variables while maintaining the ability to capture complex patterns through the mixture model structure.

Inventive Principle:
Principle #35Parameter changes

3Loss of time

If sensor data is analyzed in real-time for anomaly detection, then early failure detection is possible, but false alerts increase due to noisy sensor data and discontinuous sensor values

Engineering Contradiction:
Improveearly failure detection timingVSAvoidfalse alert reduction
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent creates a statistical copy or representation of normal operating patterns through the mixture model, trained on historical data from normal conditions. This statistical copy serves as a reference against which real-time sensor data is compared. By having this pre-computed model of normal behavior, the system can quickly evaluate current data without complex real-time computations, reducing false alerts while maintaining early detection capability.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10612999B2Diagnostic fault detection using multivariate statistical pattern library
Publication Date: 2020.04.07 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10612999B2 patent drawing
  • US10612999B2 patent drawing
  • US10612999B2 patent drawing

AI summary

A method for detecting early indications of equipment failure in an industrial system includes receiving sensor training data collected from industrial equipment under normal conditions and identifying periods of time in the sensor training data when the equipment was functioning normally; finding a pattern for each identified period of time to initialize a plurality of mixture models; learning weighting factors, mean and variance of each of the plurality of mixture models, and removing unimportant models from the plurality of mixture models; determining a Gaussian Markov random field model from surviving mixture models by calculating gating functions for each of the variables and individual mixture models; determining a threshold value of an anomaly score for each variable from the sensor training data; and deploying the model to monitor sensor data from industrial equipment using the threshold values to detect anomalous sensor data values indicative of an impending system failure.