Autoencoder Ensemble for Time Series Fault Localization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current techniques for capturing spatiotemporal patterns in large-scale distributed systems, such as cross correlation, are inefficient due to their quadratic time complexity, making it difficult to detect and prevent anomalies in domains like traffic modeling and manufacturing systems.

Innovation Solution

A computer-implemented method using an ensemble of autoencoder models trained with different seeds to capture spatial correlations, generate predictions, determine reconstruction errors, and identify common patterns across temporal segments, which represent failure fingerprints, allowing for automatic actions like restarting routers or adjusting heap space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If cross correlation is used to capture spatiotemporal patterns, then anomaly detection capability is improved, but computational time complexity increases quadratically

Engineering Contradiction:
Improveanomaly detection capabilityVSAvoidcomputational time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the computational task by dividing the ensemble of autoencoder models into multiple independent components that can be trained and executed in parallel. Each autoencoder in the ensemble processes the data independently, allowing the system to avoid the quadratic time complexity of cross-correlation while maintaining anomaly detection capability through aggregated reconstruction errors from multiple models.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces the mechanical cross-correlation computation with a neural network-based autoencoder system. Instead of computing pairwise correlations between time series data points (which is computationally expensive), the system uses autoencoders to learn compressed representations and reconstruct the data, with reconstruction errors serving as anomaly indicators. This substitution dramatically reduces computational complexity while preserving detection effectiveness.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If an ensemble of autoencoder models is used instead of cross correlation, then computational efficiency is improved, but model complexity increases

Engineering Contradiction:
Improvecomputational efficiencyVSAvoidmodel complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges multiple simple autoencoder models into an ensemble system where each model is relatively simple individually, but their collective output provides robust anomaly detection. The complexity is distributed across multiple independent models rather than concentrated in a single complex model, allowing parallel processing and improved efficiency while maintaining manageable individual model complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent changes the parameter of using multiple models with different random seeds rather than a single complex model. By varying the random seeds during training, each autoencoder in the ensemble learns slightly different feature representations, and their aggregated reconstruction errors provide more reliable anomaly detection. This parameter change (from single model to ensemble with varied seeds) improves computational efficiency through parallelization while keeping individual model complexity low.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20230176939A1Localizing faults in multi-variate time series data
Publication Date: 2023.06.08 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US20230176939A1 patent drawing
  • US20230176939A1 patent drawing
  • US20230176939A1 patent drawing

AI summary

An ensemble of autoencoder models can be trained using different seeds. The trained ensemble of autoencoder models can be run on new time series data to generate a prediction associated with the new time series data. The new time series data can include multiple dimensions per time step. Reconstruction errors can be determined for the prediction. Dimensions having highest reconstruction errors can be selected among the multiple dimensions based on a threshold. The prediction can be segmented based on bursts of the reconstruction errors over time, where temporal segments can be obtained. At least one common pattern including a set of dimensions among the selected dimensions across the temporal segments can be obtained to represent a failure fingerprint.