Gradient Deception Noise for Adversarial ML Security
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Neural network-based machine learning models are vulnerable to adversarial attacks, such as model stealing and evasion attacks, where attackers can replicate or misclassify data by exploiting gradients and output probabilities, leading to revenue loss for service providers and security breaches.
Innovation Solution
Introducing perturbations or noise into the output probabilities of neural network models to deviate the attacker's gradient calculations, while maintaining classification accuracy, by reversing the sign of the first-order derivative and adding noise at the ends of the softmax or sigmoid function, up to ±0.5, to obscure the model's training configuration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If gradient-based attacks are used to replicate or misclassify data, then attackers can steal models or evade classification, but this exposes the model's training configuration and reduces security
Solution Approach 1:
The patent converts the harmful gradient information that attackers exploit into a beneficial obfuscation mechanism. By adding dynamic gradient deception noise to the loss function during training, the model learns to produce outputs that appear vulnerable to gradient-based attacks but actually prevent successful model stealing and evasion. The harmful gradient leakage is transformed into a protective feature where the gradient noise masks the true decision boundaries.
Solution Approach 2:
The patent changes the parameters of the loss function by introducing a dynamic noise term that modifies the gradient calculations. The loss function becomes L = L_original + λ * noise, where the noise term dynamically changes during training based on the input data. This parameter change ensures that the model optimizes for both accuracy and gradient obfuscation, making it resistant to adversarial attacks while maintaining reliable classification.
2Reliability
If perturbations are added to output probabilities to protect against attacks, then model security improves, but classification accuracy may deteriorate
Solution Approach 1:
The patent applies preliminary action by incorporating gradient deception into the training process before deployment. The model is pre-trained with the noisy loss function that embeds protection mechanisms, so when deployed, it naturally produces obfuscated gradients without requiring additional perturbation steps during inference. This preliminary embedding of security measures ensures both protection and accuracy are achieved simultaneously.
Solution Approach 2:
The patent introduces an intermediary mechanism in the form of a dynamic noise term that acts as a mediator between the model's predictions and the gradient calculations. This intermediary layer obfuscates the true gradients while preserving the underlying classification logic, allowing the model to maintain accuracy while protecting against attacks. The noise term mediates the conflict between security and accuracy by decoupling gradient leakage from prediction quality.
Data Source
AI summary
Mechanisms are provided for obfuscating a trained configuration of a trained machine learning model. A trained machine learning model processes input data to generate an initial output vector having classification values for each of the plurality of predefined classes. A perturbation insertion engine determines a subset of classification values in the initial output vector into which to insert perturbations. A perturbation insertion engine modifies classification values in the subset of classification values by inserting a perturbation in a function associated with generating the output vector for the classification values in the subset of classification values, to thereby generate a modified output vector. The trained machine learning model outputs the modified output vector. The perturbation modifies the subset of classification values to obfuscate the trained configuration of the trained machine learning model while maintaining accuracy of classification of the input data.


