Shadow GNN Models for Security Threat Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Graph neural network (GNN) models are vulnerable to security threats due to external access, which can lead to theft and unauthorized use, allowing malicious actors to replicate and resell network services.

Innovation Solution

A method involving analyzing the input format of GNN model data, generating probing data, querying the GNN model, building shadow models, verifying performance metrics, and performing security actions to protect against potential threats by degrading the performance of shadow models if they match the target model's metrics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If external access is allowed to GNN model data, then model functionality and service accessibility are improved, but security vulnerability increases allowing theft and unauthorized use

Engineering Contradiction:
Improvemodel accessibilityVSAvoidsecurity vulnerability
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary detection by building shadow models before actual theft occurs. The shadow model training process proactively identifies vulnerable GNN models by attempting to replicate them, allowing security measures to be implemented before unauthorized use can happen.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements continuous feedback through monitoring and verification mechanisms. Shadow models are trained and compared against original GNN models, providing feedback on model integrity and detecting unauthorized changes or theft attempts in real-time.

Inventive Principle:
Principle #23Feedback

2Reliability

If shadow models are built to detect theft, then security detection capability is improved, but computational resources and time are consumed

Engineering Contradiction:
Improvetheft detection capabilityVSAvoidmodel training time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system uses partial action by training shadow models on subsets of data or using simplified training processes. Instead of replicating the entire original model training process, the system uses efficient approximation methods to build shadow models that are sufficient for detection purposes but require less computational resources and time.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If performance verification is performed on shadow models, then accuracy of theft detection is improved, but computational complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidverification system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system extracts only the essential components needed for verification by comparing specific performance metrics and behavioral characteristics rather than analyzing the entire model structure. This extraction approach maintains high detection accuracy while reducing computational complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12174960B1Systems and methods for identifying and remediating security threats against graph neural network models
Publication Date: 2024.12.24 GEN DIGITAL INC
  • US12174960B1 patent drawing
  • US12174960B1 patent drawing
  • US12174960B1 patent drawing

AI summary

The disclosed computer-implemented method for identifying and remediating security threats against graph neural network models may include (i) analyzing an input format for model data utilized by a graph neural network (GNN) model on a target computing system, (ii) generating probing data corresponding to the input format, (iii) querying the GNN model utilizing the probing data, (iv) building, based on a query response output of the GNN model utilizing the probing data, one or more shadow GNN models, (v) verifying a performance metric of the shadow GNN models against a target performance metric associated with the GNN model, and (vi) performing a security action that protects against a potential security threat against the GNN model when the performance metric of the shadow GNN models is similar to target performance metric associated with the GNN model. Various other methods, systems, and computer-readable media are also disclosed.