Neural Network Topography for Poisoning Attack Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Artificial neural networks (ANNs) are vulnerable to adversarial attacks, particularly poisoning attacks during training, which can introduce unexpected behavior and undermine decision-making systems without requiring ongoing access, and existing detection methods lack empirical metrics for assessing and mitigating these risks.

Innovation Solution

Analyze the topographical properties of ANNs to identify vulnerabilities by generating random unit vectors and evaluating inferences at points of interest, calculating topography metrics, and applying regularization and gradient shattering to reduce vulnerabilities, while detecting attacks through discontinuity analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If adversarial attacks are applied to exploit neural network vulnerabilities, then attack effectiveness is improved, but system reliability deteriorates

Engineering Contradiction:
Improveattack effectivenessVSAvoidsystem reliability
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The patent applies preliminary action by performing vulnerability assessment and topography analysis before deploying the neural network in production. The system pre-identifies vulnerable regions in the input space and pre-calculates adversarial examples, allowing defenders to prepare mitigation strategies and patch vulnerabilities before they can be exploited in real-world scenarios.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent converts the harmful adversarial attack mechanism into a beneficial detection tool. By using the same gradient-based optimization techniques that create adversarial examples, the system generates benign adversarial examples during training to identify vulnerable regions. These previously harmful techniques are now used to map the neural network's topography and improve its robustness against future attacks.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

2Measurement precision

If comprehensive vulnerability assessment is performed to improve detection accuracy, then measurement precision is improved, but computational complexity increases

Engineering Contradiction:
Improvevulnerability assessment accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies local quality by focusing the vulnerability assessment on specific regions of the input space rather than uniformly analyzing all possible inputs. The system identifies and concentrates computational resources on vulnerable regions where adversarial examples are most likely to succeed, while reducing analysis in robust regions. This localized approach maintains high detection accuracy while significantly reducing overall computational complexity.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies partial action by performing vulnerability assessment on a representative subset of the input space rather than exhaustively analyzing every possible input. The system selects key points of interest and evaluates vulnerabilities at these discrete locations, which provides sufficient assessment accuracy for practical purposes while avoiding the prohibitive computational cost of complete coverage.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If regularization and gradient shattering are applied to reduce vulnerabilities, then neural network robustness is improved, but training complexity increases

Engineering Contradiction:
Improveneural network robustnessVSAvoidtraining complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the training process into distinct phases: standard training, vulnerability assessment, and targeted mitigation. The regularization and gradient shattering techniques are applied selectively during specific training phases rather than continuously throughout all training iterations. This segmented approach integrates robustness improvements into the training workflow while minimizing the additional complexity burden.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary vulnerability assessment module that sits between the standard training process and the final model deployment. This intermediary component evaluates the neural network's vulnerability metrics and provides feedback signals that guide the regularization and gradient shattering processes, mediating between the conflicting goals of maintaining training efficiency and improving robustness.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12572647B2Connecting adversarial attacks to neural network topography
Publication Date: 2026.03.10 BATTELLE MEMORIAL INST
  • US12572647B2 patent drawing
  • US12572647B2 patent drawing
  • US12572647B2 patent drawing

AI summary

Some implementations provide devices, systems and/or methods for quantifying vulnerability of an artificial neural network (ANN) to poisoning attacks. Some implementations provide devices, systems and/or methods for reducing vulnerability of an artificial neural network (ANN) to poisoning attacks. Some implementations provide devices, systems and/or methods for detecting poisoning attacks in an ANN. An ANN is trained to generate inferences based on a function.