Black-Box Adversarial Attacks via Markov Random Field Covariance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing black-box adversarial attack methods are inefficient in generating perturbations that can effectively misclassify deep neural network classifiers with limited query access, as they assume independent gradient terms, whereas gradients are often correlated, and require multiple steps or gradient estimation.
Innovation Solution
The method employs Markov random field parameters for covariance modeling of gradient correlations, using black-box gradient estimation and Fourier basis vectors to generate perturbations in a single step, leveraging the Fast Gradient Sign Method with a pre-specified L∞ perturbation bound, to create adversarial inputs that maximize loss and misclassify the classifier.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If existing black-box adversarial attack methods are used, then attack capability is achieved, but query efficiency is low and multiple steps are required
Solution Approach 1:
The patent performs preliminary action by pre-estimating the gradient covariance matrix using a small subset of training data before the actual adversarial attack. This pre-computed covariance information is then reused during the attack phase, eliminating the need for repeated gradient estimations in each attack step. The covariance estimation is done once beforehand, and the resulting matrix guides the entire attack process, thereby reducing both query efficiency loss and time consumption.
Solution Approach 2:
The patent applies beforehand cushioning by pre-computing and storing the gradient covariance matrix as a form of preparatory information that cushions against the need for repeated expensive operations. This pre-computed statistical information acts as a buffer that enables efficient attack generation without requiring real-time gradient computations, thus cushioning the system against query inefficiency and time loss.
2Measurement precision
If gradient terms are assumed independent, then computation is simplified, but attack accuracy decreases due to ignoring gradient correlations
Solution Approach 1:
The patent applies parameter changes by transforming the gradient estimation problem into a covariance matrix estimation problem. Instead of estimating full gradient vectors which are high-dimensional and complex, the method estimates the covariance matrix parameters that capture gradient correlations. This parameter transformation reduces the computational burden while preserving the essential correlation information, thereby improving attack accuracy without proportionally increasing computation complexity.
Solution Approach 2:
The patent applies local quality by focusing computational resources on estimating only the relevant covariance structure rather than full gradient information. The method selectively captures the correlation patterns that are most important for adversarial attack generation, rather than uniformly processing all gradient dimensions. This localized approach to quality estimation improves accuracy where it matters most while controlling overall computational complexity.
Data Source
AI summary
Markov random field parameters are identified to use for covariance modeling of correlation between gradient terms of a loss function of the classifier. A subset of images are sampled, from a dataset of images, according to a normal distribution to estimate the gradient terms. Black-box gradient estimation is used to infer values of the parameters of the Markov random field according to the sampling. Fourier basis vectors are generated from the inferred values. An original image is perturbed using the Fourier basis vectors to obtain loss function values. An estimate of a gradient is obtained from the loss function values. An image perturbation is created using the estimated gradient. The image perturbation is added to an original input to generate a candidate adversarial input that maximizes loss in identifying the image by the classifier. The neural network classifier is queried to determine a classifier prediction for the candidate adversarial input.

