Gradient Deception Noise for Adversarial ML Security

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Neural network-based machine learning models are vulnerable to adversarial attacks, such as model stealing and evasion attacks, where attackers can replicate or misclassify data by exploiting gradients and output probabilities, leading to revenue loss for service providers and security breaches.

Innovation Solution

Introducing perturbations or noise into the output probabilities of neural network models to deviate the attacker's gradient calculations, while maintaining classification accuracy, by reversing the sign of the first-order derivative and adding noise at the ends of the softmax or sigmoid function, up to ±0.5, to obscure the model's training configuration.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If gradient-based attacks are used to replicate or misclassify data, then attackers can steal models or evade classification, but this exposes the model's training configuration and reduces security

Engineering Contradiction:
Improvemodel securityVSAvoidadversarial attacks
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent converts the harmful gradient information that attackers exploit into a beneficial obfuscation mechanism. By adding dynamic gradient deception noise to the loss function during training, the model learns to produce outputs that appear vulnerable to gradient-based attacks but actually prevent successful model stealing and evasion. The harmful gradient leakage is transformed into a protective feature where the gradient noise masks the true decision boundaries.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The patent changes the parameters of the loss function by introducing a dynamic noise term that modifies the gradient calculations. The loss function becomes L = L_original + λ * noise, where the noise term dynamically changes during training based on the input data. This parameter change ensures that the model optimizes for both accuracy and gradient obfuscation, making it resistant to adversarial attacks while maintaining reliable classification.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If perturbations are added to output probabilities to protect against attacks, then model security improves, but classification accuracy may deteriorate

Engineering Contradiction:
Improvemodel securityVSAvoidclassification accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by incorporating gradient deception into the training process before deployment. The model is pre-trained with the noisy loss function that embeds protection mechanisms, so when deployed, it naturally produces obfuscated gradients without requiring additional perturbation steps during inference. This preliminary embedding of security measures ensures both protection and accuracy are achieved simultaneously.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary mechanism in the form of a dynamic noise term that acts as a mediator between the model's predictions and the gradient calculations. This intermediary layer obfuscates the true gradients while preserving the underlying classification logic, allowing the model to maintain accuracy while protecting against attacks. The noise term mediates the conflict between security and accuracy by decoupling gradient leakage from prediction quality.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12050993B2Dynamic gradient deception against adversarial examples in machine learning models
Publication Date: 2024.07.30 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12050993B2 patent drawing
  • US12050993B2 patent drawing
  • US12050993B2 patent drawing

AI summary

Mechanisms are provided for obfuscating a trained configuration of a trained machine learning model. A trained machine learning model processes input data to generate an initial output vector having classification values for each of the plurality of predefined classes. A perturbation insertion engine determines a subset of classification values in the initial output vector into which to insert perturbations. A perturbation insertion engine modifies classification values in the subset of classification values by inserting a perturbation in a function associated with generating the output vector for the classification values in the subset of classification values, to thereby generate a modified output vector. The trained machine learning model outputs the modified output vector. The perturbation modifies the subset of classification values to obfuscate the trained configuration of the trained machine learning model while maintaining accuracy of classification of the input data.