GCRNN Spatio-Temporal Anomaly Detection in IoT Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Computer networks, particularly IoT networks, face challenges in detecting anomalies such as Denial of Service (DoS) attacks due to the dynamic nature of network behaviors, lack of ground truth for normal vs. abnormal behavior, and the difficulty in differentiating between noise and relevant anomalies, especially in highly dimensional spaces with constrained resources like Low-Power and Lossy Networks (LLNs).

Innovation Solution

The implementation of a spatio-temporal anomaly detection system using Graph Convolutional Recurrent Neural Networks (GCRNNs), which combines graph convolutional neural networks (GCNNs) and convolutional long short-term memory recurrent neural networks (ConvLSTMs) to analyze sensor data from nodes in the network, considering both spatial and temporal aspects, and initiates mitigation actions when anomalies are detected.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional anomaly detection methods are used in IoT networks, then the system is simpler to implement, but the detection precision and ability to identify complex anomalies deteriorates

Engineering Contradiction:
Improveanomaly detection precisionVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The detection system is segmented into multiple specialized components: GCNN for spatial feature extraction from graph-structured network data, ConvLSTM for temporal pattern recognition, and separate processing streams for different anomaly types. This segmentation allows each component to excel at its specific function while maintaining overall system manageability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transforms traditional anomaly detection by adding spatial and temporal dimensions to the analysis. Network data is represented as graph structures with spatial relationships, and time-series patterns are incorporated through ConvLSTM, moving beyond simple threshold-based detection to multi-dimensional pattern recognition.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If complex GCRNN models are deployed for spatio-temporal anomaly detection, then the detection accuracy improves, but the resource consumption and computational overhead increase

Engineering Contradiction:
Improveanomaly detection accuracyVSAvoidcomputational resource consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary action by pre-training the GCRNN model offline using historical network data to learn normal behavior patterns. This pre-training phase captures temporal and spatial dependencies, enabling the model to make accurate predictions with reduced computational overhead during real-time deployment on resource-constrained devices.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A lightweight intermediary layer is introduced between the complex GCRNN model and the resource-constrained IoT devices. This intermediary handles heavy computational tasks such as model inference and anomaly scoring, allowing the core detection logic to run efficiently on devices with limited processing power while maintaining high detection accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If the system monitors all network nodes continuously, then the detection coverage is complete, but the false positive rate increases due to noise

Engineering Contradiction:
Improvedetection coverageVSAvoidsignal-to-noise ratio
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system applies local quality by customizing the detection threshold and sensitivity for each network node based on its specific characteristics, traffic patterns, and historical behavior. Instead of using a uniform threshold across all nodes, the GCNN learns node-specific spatial patterns and the ConvLSTM captures temporal variations, allowing the system to maintain high detection coverage while adapting to local conditions and reducing false positives.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10771488B2Spatio-temporal anomaly detection in computer networks using graph convolutional recurrent neural networks (GCRNNs)
Publication Date: 2020.09.08 CISCO TECHNOLOGY INC
  • US10771488B2 patent drawing
  • US10771488B2 patent drawing
  • US10771488B2 patent drawing

AI summary

In one embodiment, a device receives sensor data from a plurality of nodes in a computer network. The device uses the sensor data and a graph that represents a topology of the nodes in the network as input to a graph convolutional neural network. The device provides an output of the graph convolutional neural network as input to a convolutional long short-term memory recurrent neural network. The device detects an anomaly in the computer network by comparing a reconstruction error associated with an output of the convolutional long short-term memory recurrent neural network to a defined threshold. The device initiates a mitigation action in the computer network for the detected anomaly.