Autoencoder Ensemble for Time Series Fault Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current techniques for capturing spatiotemporal patterns in large-scale distributed systems, such as cross correlation, are inefficient due to their quadratic time complexity, making it difficult to detect and prevent anomalies in domains like traffic modeling and manufacturing systems.
Innovation Solution
A computer-implemented method using an ensemble of autoencoder models trained with different seeds to capture spatial correlations, generate predictions, determine reconstruction errors, and identify common patterns across temporal segments, which represent failure fingerprints, allowing for automatic actions like restarting routers or adjusting heap space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cross correlation is used to capture spatiotemporal patterns, then anomaly detection capability is improved, but computational time complexity increases quadratically
Solution Approach 1:
The patent segments the computational task by dividing the ensemble of autoencoder models into multiple independent components that can be trained and executed in parallel. Each autoencoder in the ensemble processes the data independently, allowing the system to avoid the quadratic time complexity of cross-correlation while maintaining anomaly detection capability through aggregated reconstruction errors from multiple models.
Solution Approach 2:
The patent replaces the mechanical cross-correlation computation with a neural network-based autoencoder system. Instead of computing pairwise correlations between time series data points (which is computationally expensive), the system uses autoencoders to learn compressed representations and reconstruct the data, with reconstruction errors serving as anomaly indicators. This substitution dramatically reduces computational complexity while preserving detection effectiveness.
2Productivity
If an ensemble of autoencoder models is used instead of cross correlation, then computational efficiency is improved, but model complexity increases
Solution Approach 1:
The patent merges multiple simple autoencoder models into an ensemble system where each model is relatively simple individually, but their collective output provides robust anomaly detection. The complexity is distributed across multiple independent models rather than concentrated in a single complex model, allowing parallel processing and improved efficiency while maintaining manageable individual model complexity.
Solution Approach 2:
The patent changes the parameter of using multiple models with different random seeds rather than a single complex model. By varying the random seeds during training, each autoencoder in the ensemble learns slightly different feature representations, and their aggregated reconstruction errors provide more reliable anomaly detection. This parameter change (from single model to ensemble with varied seeds) improves computational efficiency through parallelization while keeping individual model complexity low.
Data Source
AI summary
An ensemble of autoencoder models can be trained using different seeds. The trained ensemble of autoencoder models can be run on new time series data to generate a prediction associated with the new time series data. The new time series data can include multiple dimensions per time step. Reconstruction errors can be determined for the prediction. Dimensions having highest reconstruction errors can be selected among the multiple dimensions based on a threshold. The prediction can be segmented based on bursts of the reconstruction errors over time, where temporal segments can be obtained. At least one common pattern including a set of dimensions among the selected dimensions across the temporal segments can be obtained to represent a failure fingerprint.


